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1. Introduction, Background, and Purpose 



A. Nature of This Document 

Tliis document presents a summary of the results of the field test of the first follow-up 
of the 1992 Beginning Postsecondary Students Longitudinal Study (BPS:90/92). The field 
test and subsequent full-scale study are being conducted for the National Center for 
Fiduca 'on Statistics (NCES) of the U.S. Department of Education, Washington, DC, as 
authori. :d by law [20 USC 1221.1] and the Higher Education Amendments of 1986, as 
amended by the Hawkins-Stafford Amendments of 1988 [PL 100-297, Sections 300(i) and 
300(k)]. The study is being conducted by the Research Triangle Institute (RTI), assisted by 
Scientific Surveys International (SSI), a division of Abt Associates, and by MPR Associates. 

The remainder of this introductory chapter considers briefly the background and 
purposes of the overall study and the purpose of the field test. In Chapter II, the field-test 
design and methods are described. In Chapter III, determinations of first time beginners 
(PTEs) are discussed. Evaluation of locating procedures and institutional data collection are 
provided in Chapter IV; intei*view administration and related procedures are ^^'Tluated in 
C:hapter V; and experimental conditions and data quality are evaluated in C, ,;\r VI, with 
overall recomendations for the full scale study. 

Suppordng documentation of survey materials used during the field test are provided 
in Appendices to this report. 

B. Background anu Purpose of BPS 

The need for national data concerning issues in access, choice, enrollment, 
persistence, progress, curriculum, and attainment in postsecondary education, 
graduate/professional school, and rates of return to society, led NCES to develop an 
information system to provide comprehensive data on these conditions and attainments. The 
base for this data is NPSAS, first implemented in the 1986-87 school year, which yields a 
nationally representative cross-sectional sample of postsecondary students every three years. 
Cost-efficiency, minimization of respondent burden, and maximization of value of extant 
information dictated that the current BPS study utilize data collected in NPSAS:90 from first 
year students, and follow these students from initial enrollment in PSE through completion of 
their educaUon and entry into the workforce. 

BPS:90/92 represents a bold departure from previous longitudinal studies of high 
school age cohorts, in that it starts with a cohort of individuals beginning their postsecondary 
studies, regardless of when they completed high school . Consequently, information v/ill be 
available from BPS about "nontraditional" postsecondary students, who have delayed the 
continuation of their education due to military service, family responsibilities, or other 
reasons. This is important, since the "nontraditional" student represents a steadily growing 
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segment of the postsecondary student population. All types of postsecondary education 
students (academic, vocational/occupational, and technical) are included in the study. 

Major educational policy questions to be addressed by information collected during 
the study are: (1) how and why students continue their enrollment in postsecondary 
education, (2) how postsecondary education is financed, (3) what courses are taken and what 
grades and credits are earned, (4) what fields of study are pursued, (5) how extensive is and 
what are the patterns of transfers between colleges, (6) what is the extent and timing of 
program completion, (7) what is the extent of progress toward and attainment of degrees, 
licenses, or certificates, (8) what is the nature and timing of applicafion for and cont'nuation 
into graduate or professional school, (9) what is the impact of the postsecondary education 
experience on subsequent life experiences (jobs, family formation, lifestyles), parficularly as 
related to returns for the overaH society, and (10) how are these features of postsecondary 
education different for different types of starting postsecondary students. 

The current BPS study will be directed toward first-time entering postsecondary 
students in the 1989-90 school year, who were previously surveyed during the National 
Postsecondary Student Aid Study (NPSAS:90) and its associated field test. Baseline data for 
BPS was therefore collected during NPSAS:90. The BPS:90/92 first follow-up field test, 
involving 1,9^1 students entering 67 postsecondary institutions in the 1988/89 school year 
has now been completed. The full-scale first follow-up, BPS: 90/92 wil! be conducted during 
the winter and spring of 1992, and will involve about 11,000 postsecondary students who 
entered 1,100 postsecondary insfitutions during academic year 1989-90 (AY89-90). Both the 
field test and the full-scale BPS first follow-up involve conducting a computer-assisted 
telephone interview with sample members to determine their educational and related 
experiences during the two year interval since they were last surveyed. 



Purpose of the Field Test 

The driving purpose of the field test was to evaluate all operational and 
methodological procedures, instruments, and systems to be used in the full-scale study. 
Procedures examined (and discussed in the remainder of this report) include: 

• Procedures for identifying FTBs. 

• Pre-CATI and intensive tracing procedures (including mailing and telephone 
tracing, institutional coordination and data collecfion). 

• Interview control and administration (including additional tracing, response 
rates, timing, time of year consideration, missing data propensities, and 
reliability and validity of responses). 
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• Evaluation of Experimental conditions tested (including worksheets, 
rescheduling, and remailings). 

• Supporting systems and data bases (including the Integrated Control System 
(ICS), major modules of that system [i.e., tracing and CATI control], and 
various submodules [e.g., on-line coding procedures]. 

The field test was conducted during a period (March-June 1991) of high mobility for 
sample members still enrolled in school. Also the field test incorporated a number of 
experimental conditions that v/ere designed for testing (see Section II. C), many of which 
proved to be less than optimal for use in the full-scale study. For these reasons, tracing 
rates, contact rates, and response rates were less than anticipated for the full-scale study. 

The results of the field test serve to improve the full-scale study. In our evaluation 
we are quite candid in pointing out field-test failures as well as the needed changes to correct 
such problems, where applicable, in the forthcoming full-scale study. 

The specific outcome considerations that shape the design of the full-scale BPS study 
include: (1) operational measures; (2) selecting, contacting, and interviewing sample 
members; (3) relative response and break-off rates; (4) inten/icv, completion times; (5) rate 
of response inconsistencies; (6) debriefing comments; (7) data processing efficiency; 
(8) respondent contact procedures; (9) respondent motivation levels and difficulties (ease) of 
administration; (10) interview scheduling and memory aids; (11) item and section completion 
times; (12) validity; and (13) reliabihty. 
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II. Field Test Design and Method 



A. The BPS:90/92 Sample 

The BPS:90/92 field test sample consisted of students beginning postsecondary 
education for the first time in the 1988-89 school year (i.e., between July 1, 1988 and 
June 30, 1989). This sample was a subset of the field test sample for the 1990 National 
Postsecondary Student Aid Study (NPSAS:90). The NPSAS:90 field test sample covered all 
sectors of postsecondary education and all students enrolled in those sectors during the 1988- 
89 school year. All institutions offering programs in postsecondary education that were 
academically or vocationally oriented were eligible to participate in NPSAS^ Specifically, 
to be considered eligible for NFS AS, an institution must have: 

• Offered an educational program designed for persons who have completed 
secondary education; 

• Offered programs that were acadeniically, occupationally, or vocationally 
oriented; 

• Made program offerings available to persons other than those employed by the 
institution; 

• Offered more than just correspondence courses; 

• Offered programs that last at least three months or 300 contact hours, and 

• Been located in the 50 states, the District of Columbia, or Puerto Rico. 

Institutions were excluded if they: 

• Only served secondary students; 

• Only provided vocational, recreational or remedial courses (such as driver 
training schools and dance courses); or 

• Provided only seminars of relatively short duration. 

The NPSAS:90 full student sample was drawn over multiple time segments (i.e., a 
fall sample and non-fall samples) to capture enrollments throughout the school year of 
interest (July 1, 1989 through June 30, 1990). The field test sample, however, was drawn 
from enrollment at a single point in time. For a student to have been eligible for the 
NPSAS:90 field test sample, he/she must have been enrolled in an eligible institution in the 
fail term (or during October, 1988) of the 1988-89 school year. In addition, the student must 
have been enrolled for one or more of the following purposes: 



The NPSAS universe includes all institutions in the 1987-88 IPEDS 

Institution Characteristics (IC) file (the most recent available at the time 

of institutional sample selection) plus a small number of institutions which 

became elegibile to participate in Federal student aid programs after that 

file was created. See Methodology Report for the 1990 National Postsecondary 
Student Aid Study > NCES 92-080 for further details. 
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• Taking course(s) for credit; 

® In a degree or formal award program; or 

• In an occupationally specific program. 

Regardless of meeting these criteria, students who were in a high school program 
were not eligible. As a result of field test CATI responses, some students originally 
determined eligible were found to be ineligible. (See Section III.D for an in depth discussion 
of post hoc FTB classification.) 

Students were eligible even if they were only enrolled part-time, and irrespective of 
their residence or citizenship status in the U.S. All other students, such as those only taking 
a course for remedial or avocational purposes and not receiving credit, those who were only 
auditing courses, or those who were only taking courses for leisure rather than as pare of an 
academic, occupational or vocafional program or course of study, were not eligible for the 
NPSAS;90, and not eligible for the BPS:90/92. 

The base year (NPSAS:90) field-test sample was drawn from purposively selected 
postsecondary institutions. Procedures used in selecting the institutions and students from 
them are provided in a separate NPSAS:90 report.^ The BPS:90/92 student sample was 
selected based on availability of prior interview data and partially on classifications of sample 
members as First Time Beginning (FTB) students. A more detailed discussion of selection 
procedures used to determine the BPS:90/92 sample is provided in Section III.B. 

Table II. A. 1 illustrates the composition of the NPSAS:90 sample with interview data 
and the initial BPS:90/92 field test sample by level and control of the associated institutions. 
Overall, there were 4,501 students in the field test sample, including 3,256 from 73 
institutions who had interview data. The 1,981 students, from 67 institutions, initially 
selected from these 3,256, included some sample members known to be non-FTBs (e.g., 
upperclassmen, graduate students) who had been identified by institutions as first-year (but 
not necessarily beginning) students. The purpose of including these students was to provide 
a comparison group for subsequent FTB identification modeling (see Section IIl.C). These 
non-FTBs were later dropped from the sample for compatibility with the full scale study. 

B. Overall Design and Control 

The field test design involved mail and telephone efforts to trace field-test sample 
members to their current location and to conduct a computer assisted telephone interview 
(CATI) with them to determine their educational and related experiences during the two year 
interval since they were last surveyed. An important part of the tracing was an institutional 
data collection/verification form-the Administrative Information Sheet-which was to be 
completed by institutional representatives from the NPSAS:90 institution from which they 



^ National Center for Education Statistics, Sandra Garcia and Gerald S. Malitz, 19QQ Nation al Postsecondary 
Stud ent Aid Study: Field Test Methodology Report (Technical Report). Washington, DC: 1989. 
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Table II.A.l. Composition of the NPSAS:90 and BPS:90/92 Field Test Samples, by Level 
and Control of NPSAS:90 Institution 







NPSAS:90 
Field Test 
Students' 


BPS:90/92 
Field Test 
Students^ 


NPSAS:90 
Field Test 
Institutions' 


BPS:? 
Field 
Institu 


)0/92 
Test 
tions^ 


Level 


Control 


N 


Percent 


N 


Percent 


N 


Percent 


N 


Percent 


Less Than 


Total 


525 


16.1 


525 


26.5 


31 


42.5 


31 


46.3 


2 Year 


Public 


109 


3.4 


109 


5.5 


4 


5.5 


4 


6.0 




Independent 


70 


2.1 


70 


3.5 


4 


5.5 


4 


6.0 




Proprietary 


346 


10.6 


346 


17.5 


23 


31.5 


23 


34.3 


2-3 Year 


Total 


564 


17.3 


564 


28.5 


17 


23.3 


17 


25.4 




Public 


356 


10.9 


356 


18.0 


8 


II. 0 


8 


11.9 




Independent 


110 


3.4 


110 


5.6 


5 


6.8 


5 


7.5 




Proprietary 


98 


3.0 


98 


4.9 


4 


5.5 


4 


6.0 


4 Year^ 


Total 


2167 


66.6 


892 


45.0 


25 


34.3 


!9 


28.3 




Public 


1283 


39.4 


482 


24.3 


13 


17.8 


li 


16.4 




Private* 


884 


27.2 


410 


20.7 


12 


16.5 


8 


11,9 


ToUal 


3256 


100.0 


1981 


100.0 


73 


100.0 


67 


100,0 


Public 


1748 


53.7 


947 


47.8 


25 


34.3 


23 


34.3 


Indepcndcn 


t^ 


1064 


32.6 


590 


29.8 


20 


27,4 


h 


25.4 


1 Proprietary 


444 


13.7 


444 


22.4 


28 


38.4 


27 


40.3 



NOTE: Percentages provided are based on col'.Tin totals. 

' Statistics are based on the 3,256 student? with interview data from the A, 501 students in the field test 

NP$A$:90 sample. . 
^ Statistics are based on the 1,981 students selected from the 3,256 students with interview data in the 

field test sample. 

^ Includes all 4 year schools, including those which offer graduate degrees in addition to bachelors 
degrees. 

Private includes both independent and proprietary schools. Included in this count for the NPSAS:90 field 
test sample is a single A-year proprietary school and its stuoents. Since none of these students were 
eligible for BPS:90/92, neither the school nor the students are included in the BPS:90/92 counts. 
Includes students in the 4-year proprietary college. 




were sampled. In addition to requests for directory information verification/update, the form 
also requested current enrollment status in the same or transfer institution, and location of 
employment (if applicable). 

Procedures used in gathering tracing information and collecting data were 
straightforward. An overview of these procedures is shown in Figure II.B.l. Letters to 
students notifying them of the forthcoming survey were mailed prior to 0MB clearance. 
Student mail packets included a study information leaflet (explaining study purpose and 
confidentiality as well as identifying endorsing agencies) and a request for updated tracing 
(directory) information. As an experimental treatment in the field test, a sample of students 
was also mailed worksheets to assist them in organizing their experiences in the areas of 
employment and education during the subsequent interview. Section VI.A discusses the 
results of the worksheet condition experiment. Mail packets (including letter, study 
information leaflet, and tracing information) were also prepared for tracing sources 
previously identified by the respondent. Copies of all such letters and associated materials 
are provided in Appendix A. Additional tracing (using forwarding addresses provided by the 
postal service and other locating approaches) was implemented to obtain an up-to-date 
address and telephone number for each sample member. 

Also prior to 0MB clearance, data collected during the NPSAS:90 field test were 
preloaded into the CATI records to be used during interviewing. Initial contact with 
institutional representatives of the NPSAS:90 field test schools that contained FTBs was also 
initiated prior to 0MB clearance. However, collection of tracing information and 
information regarding current enrollment, transfers, or job placement was deferred until 
clearance was obtained. Prenotification letters, information requests and instructions, and 
other correspondence enclosures utilized in the institutional mailout are also included i.i 
Appendix A. Information collected from institutions regarding the student was added to the 
CATI files prior to the interview to provide prompting information and to serve as validating 
information (where applicable) for student responses during the interview. 

Interviews used both NPSAS:90 field test data and current institutionally provided 
administrative information to guide the interview and validate individuals' responses. 
Contacting students for interviewing was facilitated by prior tracing activities. 

All tracing and data collection and process activities were under the control of an 
Integrated Control System (ICS). The versatility of this system is highlighted by the fact that 
various tasks were performed at different sites. However, the system enabled tight control 
on all phases of operation and provided accurate reports to NCES on each phase and across 
all phases. Overall ICS coordination was handled by a mai^^er system, designed to interface 
with survey data files and with CATI-embedded control systems. This system was modeled 
on relational database management system concepts and used keys and linked files for 
efficiency, and provided easy access to all files and data elements. This master system 
interacted with five other modules as indicated in Figure II.B.2. The system also provided 
necessary security and limited access to confidential data. Major control modules oi the ICS 
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Figure II.B.l Flow of tracing and data collection activities for BPS:90/92 field test 
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Figure ILB.2. 



Basic configuration of BPS:90/92 Integrated Control System (ICS) 



Basic Configuration of BPS integrateci Controi System C I CS;) 




Notes: Dashed lines indicate telocomtnunications lints^ with 
the exception of production f iles and prograrrs^ ai! modules 
are directly accessible to NCES for reirote query. 



were the Prefield Locating Module (PLM) and the CAT! Locating/Inter\Mewing Module 
(CUM). 

The master ICS served the major functions of controlling data flow and management, 
CATI operations, data extraction, editing/coding, documentation, and file preparation for 
delivery. Status information was transmitted from each of the modules to the master ICS as 
update transactions to allow control of the flow of events in the system and to ensure proper 
performance of study requirements. Status reports documented individual and/or overall 
progress in terms of specific tasks. 

The BPS field-test database was established as a relational database with logical 
categories defining the varying data tables (files) at RTI, SSI/AAI, and MPR Associates. 
The relevant databases included NPSAS base year data, directory/locating information, 
survey data collected via CATI, and deliverable reports and files. 
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C. Methodological Experiments and Evaluation Approaches 

Each major component of the field test was evaluated. The evaluation methodology 
consisted of both formative and summative analyses. Formative evaluations were of an 
ongoing nature and were designed to assess a task at intermediate stages so that the effects of 
employing alternate methodologies could be analyzed and modifications and revisions could 
be employed and assessed prior to task completion. Summative evaluations assessed the 
results of the field test, including all attempts at modification of the workflow, and will be 
used to optimize procedures in the full study. A summary of field test evaluations that were 
planned is provided in Figure II.C.l. 

In order to adequately evaluate the design and method of the field test, separate 
debriefing sessions were conducted with survey operations staff, interviewers, interview 
monitors, and interviewer supervisors. Debriefing discussions covered issues relevant to 
each group of survey staff Based in part on the debriefing comments, adjustments are being 
made to item wording, question format, and survey procedures, as necessary, to ensure 
efficient and effective survey implementation as well as higher interview response rates. 

The field test also considered two methodological enhancements for possible 
implementation in the full scale BPS:90/92 study: 

(1) Interview Scheduling : It was expect:d that some respondents could require 
over an hour to complete the interview. It was hypothesized that they would 
be more likely to complete a long interview if allowed to schedule a 
continuation appointment based on expected interview length; and 

(2) Memory Recall Aids : Some of the interview modules ask for detailed 
information about precise time periods, and two aids were developed to 
facilitate accurate recall. 

Additionally, two separate reinterview procedures were implemented for subsamples of 
respondents: (1) a reliability reinterview, with a repeated (after 2-4 weeks) interview using 
selected items about educational experiences/financing and employment history; and 
(2) intensive reinterviews on the same subject matter using cognitive laboratory prompts and 
follow-up questions to provide information about response validity. Respondents wjre 
sampled on-line for each of these reinterviews at the conclusion of the initial interview. At 
the completion of the original interview, 120 respondents were randomly selected for the 
reliability reinterview and 75 were selected for the intensive validity reinterview (with each 
reinterview group divided equally among worksheet groups). Additional formal checks on 
response validity involved comparison of individual responses with responses provided from 
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Figure II.C.l. 



Field test evaluation summary 



Major Area of Evaluation 
FTB Identification 

Systems Operation 

Tracing Activities/ 
Institutional Data Collection 



Interview Administration/ 
Data Quality 



File Development 



Verity N PSAS: 90 response used to identify variously defined groups 
of FTBs 

Model FTB identifi a*' •;, among cases missing some CATI data 
elements. 

Observe (and correct) all anom.alous systems operations. 
Debriefing of Institutional Contacts. 
Debriefing of tracing staff. 
Analysis of tracing results. 

Modeling of "best source" for telephone numbers. 

Debriefing on silent monitoring. 

Analysis of CATI production report statistics. 

Debriefing of interviewers and "Refusal Convertors". 

Analysis of statistics on timing, overall and wilhin interview 
segments. 

Analysis of rates of interview nonresponse, early and subsec]uent 
break -off, types of response inconsistencies detected during interview 
administration. 

Formal analysis of embedded methodological experiments: alternate 
interview approaches, memory recall aids, and interview scheduling. 

Validation analyses using relationships between data items provided 
by both institution and respondent and intensive clinical reinterviews. 

Analyses of response temporal stability by reinterviews of selected 
interview sections. 

Observation and documentation of procedural difficulties encountered 
in record reformatting, weighting, disclosure analysis, and masking. 
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institutional records on the Institutional Administrative Shee*. (see Appendix B). Results of 
these analyses are provided in Chapter VI. 

1. I nterview Scheduling 

To test uie interview scheduling, respondents were separated into two groups: those 
requiring short interviews and those requiring lon g interviews . The classification was made 
as the interviews proceeded, based on interview progress within the first 40 minutes. All 
respondents who got at least as far as Section H (Goals, Aspirations, Expectations) within 40 
minutes were classified as short interview respondents, expected to complete the BPS 
interview in no more than an hour. Respondents who did not reach Section H within 40 
minutes were classified as long interview respondents, expected to require at least an hour to 
complete the BPS interview. No shoit interview respondents were offered the scheduling 
option although they still had the implicit option to reschedule. Long interview respondents 
were randomly assigned to one of two scheduling groups who received different instructions 
roughly 40 minutes into the interview. Respondents assigned to the no schedule option group 
were not offered an explicit rescheduling option. Respondents assigned to the reschedul e 
option group were given an explicit option to complete the remainder of the BPS interview ^t 
a later time, which they could accept or decline. The interview scheduling manipulation 
created a total of four groups of respondents: 

(1) those falling in the short interview group 

(2) those assigned to the no schedule option 

(3) those assigned to the reschedule option but choose not to take it 

(4) those assigned to the reschedule option who choose to make a later 
appointment to complete the interview. 



2. Memory Recall Aids 

The memory aid hypothesis was based on "worksheet" memory aids that were mailed 
to respondents before they were contacted for phone interviews (see Appendix A). There 
were two worksheet memory aids; one dealt with educational history and expenses and the 
other dealt with employment history. The worksheets were designed to help respondents 
think about and organize information requested in the education and employment modules of 
the survey instrument. It was expected that respondents who received these worksheets (and 
had them available during the interview) would complete the related modules more quickly 
and would give more accurate interview responses than respondents who did not receive the 
worksheets. Further, for those who chose to use the worksheets prior to the interview, even 
greater gains in interview completion time and accuracy were anticipated. The field test 
sample was randomly assigned to receive the education worksheet, the employment 
worksheet, or neither worksheet. 
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IIL Deterniinafion of First Time Beginners (FTBs) 



A, Preliminary File Work 

Seven data files were received from the NPSAvS:90 field test for use in BPS:90/92 
field test. An Institutional Coordinator file contained the institution name, coordinator name 
and school address for the 73 institutions that participated in the NPSAS:90 field test. Two 
files contained locating information, one from institution records and the other from the 
student interview. The Locator file with information from the student interview had three 
sources of student contact (the student him/herself, a contact periOn, and parent/ guardian). 
The Lx)cator file with information from the institution had four sources of student contact 
(student local and permanent address, a contact person and parent/guardian). 

The remaining four files were a Record Abstract data file (with complete data only 
for graduate level students in the field test), a student Base data file (with base-year 
institution-reported level and student interview data), a School data file (from the student 
intei-view), and a Term data file (also from the student interview). The Record Abstract data 
file contained data for 758 students. The Base data file contained student CATI basic and 
longitudinal information along with data concerning other schools attended. Only student 
level was included from the institution information on the base file. This file was of variable 
record format depending on the extent of "other school" data provided, The School file 
contained CATI school and financial aid data. The Term tile contained information on 
school terms, student major, employment data, and student expense information. This file 
too, was of variable record format due to the varying number of terms students were 
enrolled. 

15. Subsetting lo FTIJs 

For the NPSAS base year field test, potential FTBs were identified from institutional 
reports of first time attendance at that institution, while the NPSAS full scale identification 
was to be much more precise. The broad field lest definition presented both a problem and 
an opportunity. The problem was that actual first-time beginners had to be identified. The 
opportunity was that by having all first-time students at an institution, broader FTB 
definitions could be tested. To this end, several possible levels of FTB were identified^ and 
appropriate questions were asked to classify people into these categories, though "true" or 
"pure" FTBs were of primary interest. Base year data was not sufficient to identify "pure" 



"True" or "pure" FTBs are those vjho are entering postsecondary 
education for the first time after high school. Other levels considered v;ere 
those who changed from vocational to academic programs or vice versa, and those 
who had entered postsecondary education previously, but had not participated 
actively for over 10 years - rebeginners. The full scale BPS: 90/92 will contain 
only "true" FTBs. 
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FTBs, but would allow a broad definition (whicli could also include transfer students) from 
which to narrow the potential pool. Final identification was based on individual resiwnses lo 
BPS items. 

Initial FTB determination was made by extracting variables related to "student's level 
in school" and other "key" variables from the data files. Table III.B.l illustrates data 
availability patterns and potential FTB classifications. For this phase of the field test, 
students were classified as FTBs or non-FTBs on the basis of the three indicators: one from 
the student interview and two from the in.slitution (the latter two indicators, student level 
from institution records on the student base file and level on the institution locator file, were 
supposedly identical, but were not in several instances)'. If any of these three indicators 
indicated "first-year student" the sample member was classified as a Potential FTB; otherwise 
the individual was classified as non-FTB. Further, individuals were classified as 
"confirmed," "not confirmed" or "conflict" on the basis of agreement of the available 
indicators. If only one of these indicator variables was available, the FTB classification was 
considered "not confirmed"; otherwise, if multiple indicators were available and all were in 
agreement, then the case was classified as "confirmed"; disagreement among multiple 
indicators led to the classifications of "conflict". 

Individuals with no NPSAS:90 interview data were not to be included in the 
BPS:90/92 sample; all such individuals had only one available indicator (level on the locator 
file) and were necessarily unconfirmed. Of those remaining 2,005 NPSAS:90 sample 
members (represented in the last two row categories under Potential FTBs), 24 had complete 
record abstract data, which was not supposed to have been collected for first time students. 
Consequently, these cases were reviewed manually. In all cases, these students were either 
First-Time Professionals or Graduate students. This left only one category (interview data 
only), with a total of 1,981 students, as the final basis for the BPS:90/92 field test sample. 

Additional base-year interview items were extracted from the data files to further 
verify the legifimacy of the 1,981 cases as FTBs. Items considered were (1) completion of 
Bachelor's degree prior to 7/88, (2) year postsecondary education was started, (3) enrollment 
in other postsecondary school, and (4) attending NPSAS:90 school prior to 7/1/88. Again, 
many were clearly graduate or first professional students. All 1,981 cases were initially 
retained in the BPS:90/92 field-test sample; however, they were identified as members of 
three FTB categories: (1) highly likely FTB, (2) questionable FTB, and (3) highly unlikely 
FTB. The 1,350 students with no data conflicts were assigned to the highly likely FTB 
category; the 500 "confirmed" cases with questionable interview responses were assigned to 
either the questionable or unlikely FTB category. Those with three or more "yes" responses 
or two or more "yes" responses and having begun postsecondary education prior to July of 
1988, were assigned to the unlikely FTB category, the others were assigned as questionable 



' Not all indicators were available for all students. For instance, interview records were available only for 
those with partial or complete interviews. Student locator records were available only for those who completed the 
interview. 
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FTBs. The 131 initial "conflict" cases were assigned an unlikely FTB status if they 
responded "yes" to either (1) having received a prior bachelor's degree or (2) having been 
enrolled in some other postsecondary school at another time. Those answering "no" to both 
these questions were assigned as questionable FTBs. 



C. Expanded FTB Classification and Prediction Modelling 

While identification of a "pure" first time (ever) entering postsecondary student is 
relatively straightforward, an expanded definition was desired to better reflect the fact that 
different sectors of the postsecondary community may wish to define first time beginning 
students (FTBs) in different ways. Students entering strictly technical /occupational schools 
for the first time are considered FTBs regardless of the extent of the students prior academic 
education (as an example, a Ph.D. in Electrical Engineering would be considered an FTB for 
purposes of entering a cabinetry program at such institutions). Similarly, academic 
institutions typically consider a student as FTB regardless of the amount of unrelated training 
received in strictly technical/occupational institutions (as an example, a licensed electrical 
assistant entering an academic institution to pursue a Physics major would be considered an 
FTB by the academic institution). Additionally, students "reentering" postsecondary 
education after an extended period of time are considered by many to be "rebeginners" and 
are currently under consideration for inclusioii in future cohorts. The way in which the 
NPSAS field test was designed allowed us to evaluate the likelihood of occurrence of the 
various expanded definitions. This expansion of definition will not be available in the full 
scale survey because FTBs were self identified rather than initially identified by the 
institution. 

An important function of the field test was to determine FTB status, including 
ineligibility Since data elements available from the base-year were not sufficient -oi the 
expanded 1 fB identification/classification, such questions were included in the field test 
instrument. Students were assigned to all expanded FTB categories. The majority of the 
cases (79.5%) were "pure" FTBs, as would be expected. 

Given the final (expanded) FTB classification, it was considered iinportant for 
inclusion/exclusion rules for later studies, to determine the extent to which post-interview 
status could be predicted based on base-year data elements. For purposes of these analyses, 
final post-interview status was collapsed into three categories (Non-FTB-including 
ineligibles. Pure FTB, and Other FTB). The variation of the collapsed post-interview FTB 
classification over different types of postsecondary institutions is interesting. Non-FTBs 
were identified least frequently in the 4-year schools and most frequently in the less-than-2- 
year schools. This same pattern was also observed for "other" FTB classification. Also, a 
considerably higher rate of non-FTBs in the independent non-profit sector was seen within 
the less than 4-year schools. 



III-4 



26 



Table III.C.l. 



Final FTB status compared to pre-interview FTB classification 



Group 


Pre- 
Interview 
FTB Status* 


Final FTB Classification 


Non-FTB 


Pure FTB 


Other FTB 


N 


Percent 


N 


Percent 


N 


Percent 


Total 


Likely 


20 


1.74 


814 


70.66 


26 


2.26 


Unlikely 


125 


10.85 


102 


8.85 


65 


5.64 



NOTE: Statistics are based on those sample members who completed Section A of 
the interview (N=1152). 

' Pre-interview FTB Status was determined from NPSAS:90 variables, as 
described in Section IIl.A.l. 



Table II1.C.2. Final FTB status compared to Post Hoc FTB prediction 



Group 


Predicted 
FTB Status' 


Final FTB Classification 


Non-FTB 


Pure FTB 


Other FTB 


N 


Percent 


N 


Percent 


N 


Percent 


Total 


FTB 


91 


7.90 


908 


78.82 


82 


7.12 


Non-FTB 


54 


4.69 


8 


0.69 


9 


0.78 



NOTE: Statistics are based on those sample members who completed Section A of 
the interview (N=1152). 

' Post Hoc Classification was based on rules using only NPSAS:90 variables. 
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Post hoc modelling of alternate prediction models was undertaken, to minimize both 
overall error rate and numbers of false negali' v classifications. Prediction was accomplished 
using the base-year variations identified in Sccion III.B plus year of high school graduation 
and level-of-offering/control of NPSAS:90 school; classification rules differed depending on 
student category. 

The final model resulted in misclassification for 108 (about 9.4 percent) students. 
Classification results comparing final FTB status with the pre-interview determination is 
shown in Table III.C.l and results for the final post )ioc rule are provided in Table III.C.2. 
As can be seen by comparison with Table III.C.l, the dramatic reduction in number of false 
negatives achieved by the optimized prediction has led to an associated increase in both the 
number and rate of false positive (this trade-off is a basic feature of such optimization 
approaches that deal with Receiver Operating Characteristics parameters). Given the 
perceived greater impact of false negatives, however, the overall final solution is considered 
quite acceptable. Greater prediction precision was considerably hindered by the differences 
between base-year responses and BPS:90/92 responses for the variables used in the prediction 
equation. (As an example, of the 32 individuals reporting receipt of bachelor's degree 
during NPSAS:90, over half (N = 18) reported no such degree in the BPS:90/92 interview.) 
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IV.Evaluation of Locating Procedures and Institutional Data Collection 



A. Pre-CATI Tracing, Institutional Survey, and Intensive Tracing 

The principal purpose of the initial locating phase and subsequent interview tracing 
was to facilitate the task of the CATI inter/iewers by enabling them to spend as much time 
as possible contacting and interviewing respondents and as little time as possible finding 
respondents to interview. To accomplish this purpose, a two part plan was ou^ined: 

• In the initial phase of locating, telephone numbers were obtained from a 
variety of sources to provide the CATI interviewers with up to three potential 
numbers for each student. The numbers were# listed in an order of priority 
based on the best estimate of the probability ^f thei? reaching a student. 

• If neither the initially provided number(s) nor affy new numb^^cesulted in a 
student contact in CATI, the case was to be returned to the Jpc^BjBistaff for 



intensive tracing. 



An overviev/ of the CATI-extemal tracing activities and results is provnfed in 
Figure IV. A. 1. As shown in the figure, 176 cases of upperclassmen and graduatlslidents 
were removed during CATI operations prior to initial contact. These cases and ofcer 
deceased or ineligible cases determined during tracing are not included in final statistics as 
shown. Overall, this resulted in a projrxted field-test locating rate of 94 percent. 

The below-listed items of information were available in varying degrees of 
completeness from the NPSAS:90 locator files, provided either by the student or the 
institution the student attended. 

• Student telephone number where interviewed in NPSAS:90 ^ 

• Student local and permanent address; local and permanent telephone number 

• Parent(s) address and telephone number 

• Friend/relative (other) address and telephone number 

• Emergency contact address and telephone number 

Four sources of locating information were potentially available for each of the 
sampled students: the student him/herself, the parent(s), a friend/relative, and the institution 
attended by the student at the time the sample was drawn for the NPSAS:90 field test. Prior 
to the field test, locating procedures were developed that would permit an evaluation of (1) 
the student telephone numbers provided by the sources', quantitatively and qualitatively, as 
well as (2) the most reliable address to which a letter and a worksheet could be mailed in 
advance of the prospective interview. 



' Student, parent, "other", and institution 
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Figure IV.A.l. 



Field-test tracing/locating activities external to CATI 



Deceased, 
Out— of-Countr 
Otherwise 
Ineligible 
(N = 20) 



Ceases not sent 
to Intensive 
Trace 
(N-1.470) 



Final CATI 

Sample 
(N=1.514) 



Original Sample 
(N = l,98l) 



No Address/ 
Telephone 
Available 
(N = 5) 



(N = 4) 



Initial CATI Sample 
(H = 1.956) 



I 



1' 



N=l) 



I (N = 175^ 



:ases Requiring 
Intensive Trace 
(N = 311)*' 



Removed Graduate 
Students and 
Upp ere lass men 
(N-176) 



Attempted 
(N^80) 



Not Attempted 
(N = 23l) 



Traced 
(N = 44) 



Not Traced 
(N=36) 



Never Fully 
Traced 
(N = 271) 



Field Test 
[n^:.ensive Trac 
Locating Rate 
4 4/B0 = 55.0% 



Projected 
FTBs**- 
{N = ?37) 



Overall Field-Test 

Locating Rate-+ 
■ 514/1.751 56.5 



Projected 
Non-FTBs''* 
(N=34) 



Projected 
Traced 
(N=130) 



Maximum Estimated 
Field-Teat 
Locating Rate 
644/1.751 = 93. 



♦Includes 15 caa^s requiring trace after initifll contact due lo inobility. 

"Based on non-rTB rate of 12.6% among CATI complete and partial respondents 
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A simultaneous request for an update or confirmation of student and appropriate 
source locator file information was mailed to each source on the file (with the exception of 
institutions, see below). No attempt was made to contact the student by telephone in this 
phase. Some student telephone contacts occurred, but these were coincidental and resulted 
when a student answered the telephone during an attempt to contact a parent or "other". 
Attempted student telephone contacts were reserved for the CATI interviewing staff 
Attempts were made, however, to obtain information by telephone from parents and others 
who did not respond to the mail survey during the locating phase. 

This section documents the productivity of the available sources as well as the 
accuracy of the information derived from both NPSAS file data and BPS 
updates/confirmations. 

Mailing To Sources 

An initial mailout to students, parents, and others was made on December 13/14, 
1990. As a result of postoffice updates of these addresses, remails were made to 200 
students (10 percent), to 115 parents (6.9 percent), and to 92 others (nine percent). An 
additional 14 parents and one other requested remails when contacted by telephone. The 
strategy for mailing to the four sources of locating information, students, parents, 
relatives/friends (others), and institutions was designed to investigate comparisons of total 
returns by mail from each source, and the selection procedures for student addresses. 

A related assessment was planned to determine whether the value of the relationship 
established with the NPSAS institutional coordinator demonstrated a significant enough effect 
that an effort should be made to retain the NPSAS coordinator where possible. Results of all 
pre-CATI tracing and survey activities are provided in Table IV.B.l. 

1. Student Mailing 

The mailout to the students served three purposes: (1) advance notification of the 
interview, (2) a request for current address and telephone numbers, and (3) inclusion of a 
worksheet to be used during the interview. Letters and enclosures appear in Appendix A. 
Mail return of completed update/confirmation forms was low for all groups, but student 
returns were the lowest. Only 10.7 percent of the students returned the requests mailed to 
them, as was shown in Table IV.B.l. The total response from students, including mail and 
coincidental telephone contacts, was 13.8 percent. One student reached by phone refused; 
three students were reported deceased. 

The analysis shown in Table IV. B. 2 indicates that student returns from mail sent to 
any address were notably low. The total return from students was 11.1 percent of the 1 ,979 
to whom a letter and request were mailed. Although all addresses were not unique (local, 
permanent, and parent were found to be the same in various combinations), the return rates 
vary by no more than 1.7 percent. Thus, mailing requests for update/confirmation 
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Table IV. B. 2. Student returns by mail address 



Full Sample, N=1981 




by 

Institution Level 


Total 
Mailed to 
All 

Addresses 


Total j 

Mailed | 


Returned by j 
Students j 


Undeliverable j 


Not 
Returned 






U 


% 1 


U 


% 1 


n 


% ! 


ft 


% 


Local Address' 




















< 2 Year Total 


523 


420 


80.3 1 


25 


6.0 I 


67 


16.0 ! 


328 


78.1 


2 Year Total 


564 


454 


80.5 ! 


56 


12.3 1 


63 


13.9 ! 


335 


73.8 


4 Year Total 


892 


696 


78.0 1 


91 


13.1 1 


154 


22.1 I 


451 


64.8 


TOTAL 


1979 


1570 


79.3 ! 


172 


11.0 1 


284 


18.1 I 


1114 


71.0 


Permanent Address^ 




















< 2 Year Total 


523 


396 


75.7 ! 


28 


7.1 1 


57 


14.4 1 


311 


78.5 


2 Year Total 


564 


381 


67.6 ! 


48 


12.6 1 


36 


9.5 ! 


297 


78.0 


4 Year Total 


892 


452 


50.7 1 


60 


13.3 1 


34 


7.5 1 


358 


79.2 


TOTAL 


1979 


1229 


62.1 I 


136 


11.1 i 


127 


10.3 I 


966 


78.6 


Parent Address^ 




















< 2 Year^ Total 


523 


113 


21.6 1 


8 


7.1 


4 


3.5 1 


101 


89.4 


2 Year Total 


564 


161 


28.6 1 


20 


12.4 


9 


5.6 1 


132 


82.0 


4 Year Total 


892 


183 


20.5 1 


30 


16.4 


10 


5.5 1 


143 


78.1 


TOTAL 


1979 


457 


23.1 1 


58 


12.7 


23 


5.0 1 


376 


82.3 



Note: Each address table, Local, Permanent, and Parent (see following pages), includes all cases mailed to 
that address which may be equivalent to one or more of the other addresses. A particular case may, 
therefore, appear in more than one address table, since one address may be the same as another address on 
the file. Therefore, the total mailed for the three tables (all pages) combined will be greater than the 
actual total number mailed. 

' Total Mailed to local Address as a percent of the total mailed. Total Returned by Students, 
Undel i verables, and Not Returned are a percent of the number mailed to the local address. 

Total mailed to permanent address as a percent of the total mailed. Returned by Students, Undeliverable, 
and Not Returned are a percent of the number mailed to the permanent address. 

' Total Mailed to parent address as a percent of the total mailed. Returned by Students, Undeliverable, 
and Not Returned are a percent of the number mailed to the parent address. 

Public, Independent, and Proprietary breakouts for < 2 yr. suppressed, due to small cell sizes. Total 
includes all three. 
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information to students is not quantitatively productive. Undeliverable returns from the post 
office were uniformly low for all address categories. 

2. Parent mailout/telephone follow-up 

A letter was mailed to parents describing the student's participation in NPSAS:90 and 
containing information about BPS. An enclosure requested information about where the 
student could be reached (see Appendix A). The mailing w^s initiated for 1,669 parents 
those for whom the locator files contained addresses. Approximately 22 percent of the 
parents responded by mail in the three weeks before telephone followup began 
(Table IV.B.l). Information was received from 82.6 percent of all parents in the sample. 
Unlocatable, unavailability, illness, etc. accounted for the majority of those who did not 
complete. Only 1 percent refused to cooperate. Eleven others had refused but were 
converted and provided information. Two parents were deceased. 

3. Relative and friend mailout/teleph one follow-up 

As potential sources of information in NPSAS:90, students named 1,023 friends or 
relatives (others) for whom an address existed in the locator file. A letter explaining the 
survey and the student's participation was mailed to all of them, with a request for update of 
student (and their own) addresses and phone numbers (see Appendix A). Others returned 
31.5 percent of these requests by mail. Approximately 71 percent of the 741 whom locators 
attempted to reach by phone provided information. Telephone followup of others began 
about two weeks after the followup of parents which may account for their higher rate of 
returns by mail. A total response rate of 75.5 percent was obtained from others. Sixteen 
others refused. Four were reported deceased. 

4. Institutional Response 

Institution mailings. An initial mailing requesting the appointment of a coordinator 
was made to the institutions the first week in December, 1990. Institutional cooperation was 
sought in two ways. First, contact with the administrator of 67 NPSAS:90 field-test 
institutions was reestablished. At the same time an effort was made to contact each of the 
NPSAS:90 field test coordinators. The only request at that time was that the administrator 
confirm the previous coordinator for BPS or appoint a new person. In many cases the 
former coordinator indicated that he/she would continue in the role or named a replacement. 

At this stage agreement to participate and the name of a coordinator were received 
from 65 of the 67 field test institutions (one had refused and been converted). Two 
institutions had closed. An additional institution closed after naming a coordinator, and two 
proprietary institutions had been sold and the names changed. Both of the proprietaries 
named a coordinator but were later unable to provide information. One former owner 
destroyed student records; records became unavailable to the new owner in the other; these 
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two institutions were considered closed. As a result, subsequent institution reports are made 
on the basis of the 62 open institutions (except as noted in specific tables). 

Packages that included requests for information about individual sample students were 
mailed on a flow basis as assignments of coordinators were received. This second institution 
mailout to the coordinator is included in Appendix B. 

Of the 62 institutions, 53 (85.5 percent) provided either an address 
update/confirmation or enrollment information for at least one student; institutions that 
provided both address updates/confirmations and enrollment information could not always 
provide both for every student. Completed requests for update/confirmation information 
were received (by mail) for 79.7 percent of the 1,904 requested. Student enrollment 
information was received for 87.5 percent of those requested. One responding institution 
returned enrollment information but did not return any address updates/confirmations. One 
institution refused to cooperate after the coordinator had been confirmed; however, only one 
sample member had attended that institution. 

Coordinatcr Cooperation^ An attempt was made to evaluate the cooperation of 
coordinators by their previous assistance in that role for NPSAS:90. However, this 
evaluation is subject to reservations because of small numbers. Of 62 sample institutions 
(five institutions were closed and therefore excluded), 51 coordinators had assisted for 
NPSAS and only 11 were appointed specifically for BPS. Nevertheless, of these, 84.3 
percent of the former NPSAS coordinators responded compared to 90.9 percent of those 
appointed for the first time, which is not a very meaningfiil difference. 

Student employment/employer information reported by institutions^ As could be 
expected, the number of students' employers reported by institutions was highest among less- 
than-two-year institutions, which are vocational and occupational institutions. For students in 
less-than-two-year institutions, employers were identified for 42 percent. Overall, only 10 
percent of students were reported as employed and their employer identified. The numbers 
of reported transfers and institutions to which the students transferred were even smaller - 
only 4 percent overall, with the majority of those from the two-year sector. 

Student enrollment status reported by institutions* Student enrollment status (see 
Table IV. B. 3) was reported for 1,664 students (87.4 percent). Two-year institutions and 
four- year institutions provided enrollment information for 93 percent and 91 percent of their 
students, respectively. Less-than-two-year institutions provided enrollment information for 
less than three fourths of their students. The number of students still enrolled at less-than- 
two-year institutions was negligible and the number still enrolled at the two-year institutions 
was relatively low. Of those still enrolled in two-year institutions, the highest percentage of 
students was found in the independent sector. Students were most likely to be no longer 
enrolled without completing their program in the two-year institution category (63 percent). 
Some "graduation" (particularly in four-year institutions) is probably attributable to the fact 
that non-FTBs were included in the field-test working sample at this stage. 
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C. Quality of Locating Information 



The quality and quantity of the provided locating information differed dramatically among the 
four sources. In this section, quality and quantity will be measured in terms of the number 
of successful contacts made during the CATI phase of the study at the various telephone 
numbers provided from each of the sources. This number at which the student was reached 
is called the "contact number," while the word "contact" indicates that the updated or 
confirmed number that was obtained resulted directly in a successful CATI contact without 
further update. For example, 1,212, or 70.7 percent of the sample of 1,715 students were 
contacted at a student home number. 

In addition, successful contacts were made in CATI at other numbers (student work 
numbers, parent numbers, etc.) provided by the pre-field-period locating sources, as well as 
through new numbers obtained during CATI from these, and other, sources. Some of the 
following tables compare the telephone numbers a source provided vyith the contact number 
to determine contact rates, while others use only the source's report of the student home 
number as the point of reference. 

I. Contact Rates 

Table IV. C. 1 provides data on the quality of the source's report of the student phone 
number by institution type and enrollment status. The percentage is defined as the number of 
these contacts over the total number of updated or confirmed student numbers that the source 
provided. 

For the limited number of cases where the student did provide information, it was the 
best source except in the case of students who were still enrolled. Here, the parents 
provided better information than the students in the less-than-two-year and two-year 
categories, resulting in a higher percentage of contacts at the parent provided number than at 
the student provided number. The parent provides a consistently better contact than the 
"other" or the institution for all institution types and enrollment statuses. The information 
provided by the "other" is better than that provided by the institutions, except in the four- 
year institutions for students still enrolled. The sources are ranked below by the quality of 
the information they provided as defined by the overall contact rate: 

1. Student (75.6%) 

2. Parent (72.1%) 

3. Other (66.5%) 

4. Institution - Local (51.4%) 

5. Institution - Permanent (43.2%) 
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2. Contact Yield 



Quality, howev^er, must not be assessed completely independent of quantity. Quality 
reflects the verity and non-redundancy of information provided, and can thus be evaluated 
only for the subset of cases for which it was provided. Quantity or yield, reflects the extent 
of return achieved from a specified level of effort. To combine these two constructs, we 
consider the question of how many "good" responses were received of the total number 
requested, providing a cost/quality function. 

Table TV.C.2. includes the number from each source that was available rather than 
the number that had been updated or confirmed, thus providing the relative yield of contacts 
that each source provided. This table reveals that the most productive source is the parent. 
(Recall that students were not followed up by telephone for locating purposes while all 
parents, others, and institutions were.) The parent report of the student number resulted in 
contacts for 59 percent of the students for whom information was requested. The next most 
productive source was the other (49 percent), followed by the institution local and permanent 
numbers (approximately 30 percent). The students provided a contact number for a mere 10 
percent of the cases attempted. 

The sources below are now ranked by the relative yield of successful contacts they 
provided with the yield in parentheses: 

1. Parent (59.2%) 

2. Other (49.3%) 

3. Institution - Permanent (30.0%) 

4. Institution - Local (29.7%) 

5. Student (10.1%) 

While student provided numbers have the highest contact rate, and thus may provide the 
highest quality information, they also have the lowest yield because of their low response 
rate to the mailing. 

3. Redundancy 

Prior tables are useful for determining how effective a particular source may have 
been in providing a contact number, but they do not completely reveal the inherent 
redundancies in requesting the same information from different sources. 

Analysis of the redundancy is facilitated by the use of tables showing the percentage 
gain from e^ch additional source. In Table IV. C. 3, the base (44.4 percent) is the percentage 
of cases for whom one or more of the original NPSAS numbers resulted in a contact (i.e.. no 
further update was needed), l-rom this base, the additional unique contact information 
provided by each of the locating sources is shown. The total contact rate of all numbers 
from all sources was 73.5 jicrconl. liach of the small tables in Table IV.C\3 provides a 
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unique sequential combination of sources to reach that 73.5 percent and the increment in 
contact rate by adding that source. In all cases, the highest percent change of the four BPS 
locating sources is the parent. 

While the I scenario of Table IV. C. 3 is the most effective locating plan under no 
constraints, the A scenario is the most cost effective under other project constraints 
(including cost per response obtained - institutions were the least cost-effective sources). 
This scenario is analyzed for its impact on the full-scale study. This possible locating plan 
assumes that the parent will be contacted for all possible students since that source has 
proven to be the best source in these evaluations. It then assumes that locating information 
will be requested from the students, since an information packet will have to be mailed to 
students prior to the field period. With these two sources completed, the contact rate has 
reached 67.5 percent, only six percentage points shy of the upper-limit obtained by using all 
possible locating sources. The institution and the other source each would contribute only 
approximately 3 percentage points toward the overall contact rate. However, the "other" 
source can most easily be contacted if additional information is needed. 
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Table IV. C. 3. Percentage change of contact rates as selected additional sources are 

obtained^ 



Source 
Order 


Total 

% 




Preload 


44.4 


44.4 


Parent 


65.7 


21.3 


Siudeni 


67.5 


1.8 


Olhcr 


71.0 


3.5 


InsliUilion 


73. S 


2.5 



A 



Source 
Order 


Total 

% 




Preload 


44.4 


44.4 


Parent 


65 .7 


21.3 


Student 


67.5 


1.8 


Institution 


70.6 


3.1 


Other 


73.5 


2.9 



B 



Souree 
Order 


Total 

% 


A7c 


Preload 


44.4 


44.4 


Parent 


65.7 


21.3 


Institulion 


69.1 


3.4 


Student 


70.6 


1.5 


Other 


73.5 


2.9 



c 



Souree 
Order 


Total 

% 


AS^ 


Preload 


44.4 


44.4 


Institution 


53.1 


8.7 


Student 


56.4 


3.3 


Parent 


70.6 


14.2 


Other 


73.5 


2.9 



D 



Source 
Order 


Total 
% 


A9? 


Preload 


44.4 


44.4 


Institution 


53.1 


8.7 


Parent 


69.1 


16.0 


Student 


70.6 


1.5 


Other 


73.5 


2.9 



F 



Source 
Order 


Total 

% 


AS^ 


PreliKid 


44.4 


44.4 


Student 


48.7 


4.3 


Parent 


67.5 


18.8 


Institulion 


70.6 


3.1 


Other 


73.5 


2.9 



G 



Source 
Order 


Total 

% 


AS? 


Preload 


44.4 


44.4 


Other 


53.2 


8.8 


Parent 


69.7 


16.5 


histitution 


72.4 


2.7 


Student 


73.5 


1.1 



H 



Source 
Order 


Total 




Preload 


44.4 


44.4 


Parent 


65.7 


21.3 


Other 


69.7 


4.1) 


Institution 


72.4 


2.7 


Student 


73.5 


l.I 



1 



' The delta tables were proiliued tiy runnin}: freqiu-nciL-s mi tli.> mimher ot times each proyressive comliinalion 
„rs,miee(s) provided a ph<,ne niiniher that was equal to the CAT! contact numlvr. This provuied the total percent 
tiial any ot the sources provuled the contact number, Irom which the delta percentafes were derived by subtraction. 
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V. Evaluation of Interview Administration and Related Operations 

A, General Peripheral Functions 

All general operational functions related to CATI locating and interviewing were 
evaluated for efficiency to refine procedures for the full-scale study. The CATI-related 
functions of preloading, systems operations, and remailings are discussed in this section. 

1. Preloading procedures 

CATI set-up operations involved preloading NPSAS field test data elements into the 
CATI record for use as prompts and checks for the BPS responses, preloading prioritized 
telephone numbers and updated or confirmed addresses of the sample member and previously 
identified tracing sources, development of data dictionaries for on-line IPEDS coding, and 
training of inteiviewers. Actual CATI operations used a two-stage CATI program. The first 
stage program allowed interviewers to sequence through t' e provided telephone numbers in 
an attempt to reach the sample member. The second stage program consisted of the actual 
interview. In addition to the main production interview, two reinterview procedures were 
conducted for selected cases: validity reinterviews and reliability reinterviews. 

To initialize the CATI, selected data elements from the NPSAS field test data files 
were extracted for inclusion in the CATI preload file, as well as phone numbers and 
addresses that had been updated or confirmed in the initial tracing operation. A brief 
description of the variables selected from the NPSAS:90 data files along with the address 
update and prioritized locating information from the locating phase appear in Figure V.A.I. 

Many of the data elements did not require any manipulation and could be preloaded 
just as they existed on the NPSAS files. However, some were recoded, transformed, or 
combined to create new variables for preload. 

All of the prioritized locating information and updated address information was 
directly loaded into CATI following an initial edit for consistency and completeness, with the 
exception of parent locating information. Parent information was provided in one set of 
fields in the NPSAS field test. However, the CATI interview was structured such that 
questions addressed mother and father separately to coincide with the treatment of these data 
in the NPSAS:^^0 full-scale study. Thus, for the field test, NPSAS parent information was 
split into two separate sections. 

Cases were incorporated into the CATI file in three separate waves. The first and 
largest wave of CATI cases consisted of 1,563 students on March 20. The second and third 
waves consisted of 221 and 172 cases and were loaded into the CATI file on April 9th and 
April 11th, respectively. 
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Figure V.A.L 

Category 
Student 



NPSAS Institution 
Other Institutions 
Mother 
Father 

Other Contact 

Prioritized 

Locating 

Information 



Description of preload variables by category 

Variable Description 

Name: first, middle, last, maiden, nickname 

Address: street, city, state, zip, phone 

Date of Birth 

Gender 

Citizenship 

Social Security Number 

Drivers License: number and state 

Race/Ethnicity: Race, Asian, Hispanic, Native American Type 

High Institution: diploma/GED, year 

Dependency Status: 1988 tax forms 

Prior Military Service 

Prior Loans 

Worksheet Type 

full name, short name 
Level and Control of NPSAS institution Term Information 
Type of Institution: Academic, Occupational/Vocational 

Names of all other institutions attended 
Institution and Term Information 
Beginning and ending dates for each term 

Name: first, middle, last 

Address: street, city, state, zip, phone 

Deceased indicator 

Name: first, middle, last 

Address: street, city, state, zip, phone 

Deceased indicator 

Name: first, middle, last 

Address: street, city, state, zip, phone 

Relationship to Student 

Name associated with phone number: first, middle, last 
Phone number 

Contact Type Code (whose phone number) 

Contacts relationship to student 

Data Source Code (who provided number) 

Data Recency Code (how recent is phone number) 

Work Number Flag 

Priority Code (likelihood of student contact) 
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Algorithms were developed, and approved by NCES, to identify the "best" address 
for student, parent, and "other" source (which in many cases were also parents). These 
algorithms were generally effective and will be used, as applicable, for the full-scale study. 

Upon receipt of the phone/address file, a file containing special scheduling 
information, edits checks, and ICS events was generated. As errors were detected, those 
records that failed any edits were set aside for resolution. Once problems were resolved, the 
cases were re-edited and followed all subsequent steps. 

The records which passed all edits were prepared for CATL Mother and father 
deceased indicators were placed on the file to allow for sensitivity during the interview 
process. For consistency with the expected full scale files, "both parents" fields were "split" 
into appropriate separate fields manually. 

Two major changes to the preloading operation are suggested for the full-scale study. 
Parents should be uniformly partitioned into "mother" and "father" fields. The CATI is 
already programmed so that redundant address information is not collected for parents living 
together. Unspecified and multiple parent cases should be dealt with during the interview as 
were parents identified in the "other" locator field in the field test rather than manually. 

2. Systems operations 

The field test was conducted under control of an Integrated Control System (ICS) 
which contained a number of component systems. The overarching system was a control 
system/data management system implemented through the RTI FIGS (Fully Integrated 
Control System) software. Major components were the Pre-CATI Locating Module (PLM) 
and the Cati Locating and Interviewing Module (CLIM). The PLM existed at a remote site 
(AAI) and communication with other major system components was limited to electronic 
telecommunications. A number of additional file management systems were in use under 
ICS control. However, our discussion here will be limited to the major components, the 
FIGS, PLM, and GLIM, and the linkages therein. In this section, we address only the 
evaluation of the mechanics of system operation. 

Given the large number of systems and subsystems operating and the required 
integration through a telecommunications link, all systems performed remarkably well (both 
individually and in linkage). Some minor bugs were uncovered during the field test 
(principally in communications among components but sometimes within specific 
components); however, the discovery and correction of such problems was a major purpose 
of the field test. 

Both FIGS and PLM are relational database control and management systems, while 
the CATI program used in this study was not (although an internal control file is available 
within the rectangular CATI record). FICS and the GATI program were extant systems that 
operate on the RTI VAX cluster, while the PLM was specifically tailored for this study using 
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previously developed submodules for a PC network. Other RTI systems were PC-based 
(e.g., an electronic library of study documents). 

Linkages between the PLM (at a remote site) and FICS were not direct due to the 
major structural differences in the software used; basically, these two systems passed 
information to one another through telecommunicated transactions that were then processed 
by the receiving system. The linkage from CLIM was also indirect and was handled by 
passing events and transactions to FICS through the VAX cluster, similar to the method used 
for the link from. PLM to FICS. The link from FICS to CLIM was immediate; due to the 
nature of the data base management feature of FICS and the fact that both systems were 
operating on the same system, FICS was able to structure the CATI data in a manner that it 
was on-line accessible outside of the specific CATI environment. 

Despite the relative complexity of the several linkages, the minor problems 
experienced were in virtually all cases related to misunderstandings of terminology among 
the three programming groups involved. Once a common vocabulary was established, 
linkages were basically non-problematic. Likewise, operations of the general FICS system 
were basically trouble free. It did became obvious early during the operations, however, that 
both the CLIM and the FICS were over controlling related processes, while the PLM was 
basically under controlling. These matters of operational flow and control are treated 
separately in Section V.B. 

Since most of the associated subsystems associated with the CLIM (e.g., call 
scheduling module, performance monitoring module) had been pretested in a number of other 
CATI operations, no problems were experienced in seamlessly integrating them into the 
current CATI study. Some minor problems were experienced with the tracing module and 
the interview module, which operated within the overall CATI driver. The remaining 
problems represented structural constraints of the designed CATI program. 

As part of the field test, a CATI-called system was developed to allow on-line IPEDS 
coding of identified postsecondary institutions. This procedure, which is described more 
fully in Section VI. G, was quite successful. As a result, additional on-line coding programs 
for industry and occupational coding and for CIP coding of major field of study are 
recommended for the full-scale study. 

In summary, few problems existed with the project systems that could not be fixed 
during the field test. 

3. Remailings 

Students, who had not received their survey nofificafion letter or who had not 
received (or had received but misplaced) the appropriate worksheet, were given explicit 
opportunity during CATI to request a remailing of the material. In addition to providing the 
student with written formal details of study legifimacy, the remailing was considered to be a 
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motivational tool to aid in gaining participation. Also, where worksheets were involved, the 
provisions of a worksheet was considered important to: (a) reduce the time needed to 
complete the worksheet specific portion of the questionnaire and (b) to provide more reliable 
and valid data therein. 

Remails were made to about 12.5 percent of the cases contacted. Contact represents 
reaching the telephone number at which the sample member resided at the time; as such, the 
estimate is a lower bound estimate.^ 

As expected, remailing requests were a function of the worksheet group to which a 
person was assigned, as shown in Table V.A.I . Interview wording (see Appendix B, 
Question 2A.e) indicated that the worksheet would make the interview go faster. It would 
appear that respondents in the education worksheet group thought they needed a worksheet 
more than those in the employment worksheet group. 

Remail requests also varied systematically as a function of NPSAS:90 institution 
level. A slight increase in response was experienced as level of NPSAS institution increased. 
Within level, remail rates were always least for public institutions and greatest for 
independent non-profit institutions. 

The remail operation did not prove effective as a motivational tool. As shown in 
Table V.A,2, the noncompletion rate was markedly higher in the remail group. Some of this 
difference can be attributed to the mobility of the in-institution students during the interview 
time-frame; however, it seems likely that some individuals were using the offered excuse to 
delay (in some cases indefinitely) the interview. This hypothesis was supported by 
interviewers during debriefmgs (see Section V.C.3); interviewers commented that any break- 
off of the inter/iew once the sample member was on the telephone became problematic, since 
it was generally so difficult to reach them. 

Insufficient cases were available to evaluate differential reliability of responses from 
the remail group or worksheet condition (see Section VLB). 

Since remails are not inexpensive and since they yield markedly lower response rates, 
the use of planned remailings for the full-scale survey does not appear warranted. If, as 
interviewers suggest, "these people are using this option as an excuse to get off the phone," 
then the option should not be provided explicitly. It will, of course, be necessary to have an 
option for those who decide on their own that they desire a remailing (which can be handled 
by a "hot key" transfer to special screens), but the explicit offer to remail should be diopped. 
These findings add additional support to current plans for mailing to students after address 



ERLC 



' Also, during the last month of the data collection operations, interviewers were instructed to discourajjc 
remailings to avoid associated rescheduling requirements late in the operational period. 

V-5 

51 



Table V.A.I. Remails requested within worksheet group 



Worksheet Group 


Total 


Requested Remail 


N 


N 


Percent' 


No Worksheet 


478 


43 


9.00 


Employment Worksheet 


456 


52 


11.40 


Education Worksheet 


482 


83 


17.22 


Total 


1416 


178 


12.57 



Note: Cases considered in this table are restricted to those who were contacted through CATI. 
^ Percent of row total. 



Table V.A.2. Final survey results by remail status 



Final Result Code 


Total 


No Remail 


Remail 


N 


N 


Percent 


N 


Percent 


No Interview' 


264 


218 


17.61 


46 


25.84 


Partial Interview 


111 


94 


7.59 


17 


9.55 


Complete Interview 


1041 


926 


74.80 


115 


64.61 


Total 


1416 


1238 


100.00 


178 


100.00 



Note: Cases considered in this table are restricted to those who were contacted through CATI. 
' This includes refusals, lost contacts, re-contact scheduling problems, etc. 



ERIC 



V-6 

52 



corrections have been obtained from parents and closer to the same time that they will 
actually be interviewed. 

B. Control of Production Flow 

Work flow for the CATI operation included both receipt of pre-CATl updates (of 
telephone numbers and addresses) from the pre-CATI operation and sending cases to (and 
from) the intensive tracing procedure. Also the within CATI operation, a total of three 
separate programs were in operation: (1) the main interview, (2) reliability reinterviews, and 
(3) validity reinterviews. Within each CATI interviev/ type, the actual CATI program 
consisted of two interrelated modules: (1) a tracing/ locating module and (2) the actual 
interviewing module. 

Control of work flow within this relatively complex system was obviously important. 
Major systems used in implementing this control were the FICS system, the CATI-imbedded 
control system and flow logic, the CATI associated scheduler, and the CATI associated 
production monitoring system. Major reports generated from the associated systems, in 
addition to the required weekly data collection status report, included a daily CUM status 
report for all cases loaded for the three interviews, a weekly status summary across interview 
type, and a weekly production status report providing contact, interview and timing statistics 
for each of the interviewers working during Ihe week. Additionally, each daily CATI status 
report was read into a spreadsheet to evaluate actual progress in locating/interviewing against 
targeted progress. This spreadsheet and all other reports were routinely available to NCES. 

Transfer of files between pre-CATI tracing, CATI, and intensive tracing was handled 
through the FICS system, using its data base management feature. Preloading has been 
discussed in the previous section and will not be repeated here. In transferring cases from 
CATI to intensive trace, FICS queried the CLIM status file weekly and extracted cases 
identified as needing intensive trace. These cases were reviewed by a CATI supervisor to 
ensure that they were legitimate (e.g., did not include apparent "gatekeeper" or other 
"implicit refusal" cases) and legitimate cases were sent to intensive trace, while those that 
were not were reactivated in CATI with an appropriate notation on how to proceed. Cases 
returned from intensive trace were processed through FICS and new contact numbers were 
written into the CATI file and the case reactivated in CATI. 

Setting up CATI files for the validity and reliability interviews was handled directly 
by the CLIM. When a case was selected in the main production interview for either of these 
reinterview options, a record was written to the appropriate reinterview file and a date for 
reinterview (two weeks following the main interview) was established. On the appropriate 
dale, the case was activated within the appropriate reinterview mode. This procedure 
worked without problem and will be continued in the full-scale study, as applicable. 

Nightly CATI reports for the three operations, and the related spreadsheets, were 
used for purposes of determining staffing needs for future shifts. The operation and output 
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of these control tools were generally quite effective, the only changes suggested were 
inclusion of additional result codes to more finely identify certain (typically rai'e) situations 
that v/ere combined for the field-test (e.g., out-of-country and ineligible were combined as a 
single status and will be maintained as separate statuses in the I'ull-scale study). 

Production statistics for each interviewer were evaluated weekly to identify 
interviev/ers that differed from the norm in terms of per-time-unit contacts made, interviews 
completed, time to complete various portions of the interview, and time between successive 
cases. Outliers in any of these areas were required to explain any problems to their shift 
si^pervisor, and appropriate action was taken. Two interviewers were retrained as a result of 
this review (one for moving too swiftly through the interview, the other for slowness in 
moving from one case to the next). The procedures and systems used for this control 
operation were considered satisfactory and no change is anticipated for the full-scale study. 

Scheduling of cases was handled automatically, using the RTI-dcvclopcd 
autoscheduler. This routine operates in concert with CATI to preassign calling priorities 
based on time zone, type of call (e.g., schedul ed callback, unworked case), call history (to 
optimize shift assignment for the call), and other user specified options. Operation of the 
scheduler was nominal; however, subsequent evaluation of calling results (see Section V.C 
below) suggest that additional priority should be given in the full-scale study to those 
sampled from proprietary institutions and those still enrolled in four-year institutions. 

Logic flow control within the interview module of CATI was generally satisfactory, 
although some "bugs" were detected (and fixed) during operations. Need for additional logic 
flow was identified in interviewer debriefings (Section V.C. 3) and these v/ill be implemented 
for the full-scale study. 

C. Contacting and Interviewing Operations 

The process of contacting and inter\Mewing the field test sample members was 
accomplished under CATI control, and was conducted by experienced interviewers. Both the 
overall statistical results and comments of the interviewers are provided in this section. 
Timing statistics, and evaluations of data quality are provided in subsequent sections of this 
chapter. Evaluation of experimental conditions (including formal reliability and validity 
examinations) and of interviewer on-line coding results are presented in Chapter VI. 

1. Differential Contacting and Interviewing Rates 

CATI operations began on March 24th and continued for ten weeks through June 3rd. 
Of the 1,514 cases in the final CATI sample (as was shown in Figure IV. A. 1), 98 additional 
students were identified as ineligible or unavailable (e.g.. out of coimtry) prior to interview, 
and were excluded. Of the remaining 1,416 students, lull or partial inlcrviews v/cre obtained 
for over 81 percent. This figure is somewhat low, since it is reasonable to assume ttvat some 
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percentage of the refusals and other non-completions represented non-FTBs. Applying an 
estimate of the rate of such cases and excluding the projected non-FTBs leads to an overall 
intemew rate of 84.1 percent. Since virtually all of the "other" final cases v,'ere explicitly 
timing related (i.e., closed out due to inability to recontact within the abbreviated time frame 
of the field-test), one could reasonably expect an estimated maximum field-test interview rate 
of about 90 percent. In the full scale survey, a response rate of over 90 percent can be 
expected due to an earlier start and a longer time available for contacting students and for 
additional locating efforts. In the field test, both the limited time-frame and time of year 
played a significant role in the refusal rate. Specifically, inability to set later appointments 
or recontact after breakoff for refusal conversion led to about one fourth of the final refusal 
cases in the last week of data collection. 

Rates of contact and interview are shown in Table V.C. 1, by control of the NPSAS 
institution. This table shows lower contact rates for students from proprietary institutions. 
Min^ i differences in contacting rate for students from public and independent institutions 
exist within different institutional levels (with independent institution students generally 
somewhat easier to contact). Once contacted, however, the students from public institutions 
were more likely to be interviewed. 

A major implication from this is that scheduling of cases for the full-scale CATI 
op/cration should take into account the nature of the institution from which the student was 
sampled. Specifically, students sampled from proprietary institutions should be scheduled 
first to allow greater time for locating, extensive trace (if necessary), and refusal conversion. 
However, this should be moderated by the fact that students who are still enrolled will be 
harder to contact and interview at their institution, particularly once the spring terms 
approach conclusion (see sections V.C.2 and V.C.3). 

CATI yield ran somewhat behind expectations. The principal reason for reduced 
yield was that operations were only scheduled for 10 weeks; another is that the delayed start 
date (late March) placed much of the interviewing schedule in April and May, which 
confiicts with vacations, exams, and term endings for m;i! y current students. The schedule 
for the main study (starting inter\'i(ws in early February and lasting for 20 weeks) should 
avoid these types of problems, and should produce a higher yield. 

As indicated in Table V.Cl, the number of sUidents interviewed included thosi* with 
partial interviews. Over 90 percent of those inter\'iewed were FTBs and completed the entire 
questionnaire. The primary reason for partial, interviews was that those who were 
determined to not be FTBs in Seclion A did not continue the interview. While they 
technically did complete all that they were asked, tiiey were considered partial interviews Ibi* 
analysis purposes. The next most common reason for partial interviews was the inability to 
recontact the sample member after a planned or unplanned breakoff. A total of 46 such 
cases existed (41 percent of the 11 1 partial interviews). Most (32) of these cases were still 
active when the data collection |KMi(xl ended. The remainder had already been determined as 
final because their nmnber at which they had been contacted had been disconnected 
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Table V.C.I. Contact and interview completion rates by level and by control of NPSAS:90 
institution 



Level, and 
Control 


Total' 
Students in 
CATI Sample 


Number^ 
Contacted 


Percent 
Contacted 


Number 
Interviewed 


Percent of 
Contacted 
Interviewed 


Less than 2-year 


432 


328 


75.9 


262 


79.9 


2-year 


470 


410 


87.2 


341 


83.2 


4-year 


738 


678 


86.6 


549 


81.0 


Public 


754 


708 


87.5 


595 


84.0 


Independent 


474 


444 


87.7 


355 


80.0 


Proprietary 


283 


264 


71.4 


202 


76.5 


Total 


1514 


1416 


84.0 


1152 


81.4 



' Ineligibles, d£>ceused, out - of -country, uppcrc lassmen, graduate students itientifiod in the locating phase 
before CATI, and those not located during the initial locating phase have been excluded. 

'' Students contacted by telephone at any time during CATI operations, even telephone nufrher subsequently 
went bad . 

' Including partial inlerviews as long as Section A had been coiTtpleted, to determine FTB status. 



(principally as a result of their having left institution). While some of these cases represent 
implicit refusals to continue with the interview, only 1 1 cases explicitly refused to continue 
with the interview once they had completed section A. 

Given the longer interview i>e!iiKl for the full-scale study, t!ie earlier start date, and 
the fact that the prcscrcening for non-FTRs will he improved, the jiarlial interview rate 
should be considerably reduced. 

2 . Effort to Lwate an d Intervie w 

Considerable ctfort was required to locate and interview sample members, even with 
the large pre-CATI locating effort. A total of slightly over 3 and a half hours was required 
\K:r completed interview. Since interviews averaged almost one hour, 2.5 hours per 
completv'd interview was sjyjnt in U^cating the interview cases, locating and obtaining partial 
interviews, and dealing with cases for whom no {or insignificanl) inter\ie\s data were 
collected. 
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The extent of the effort is also reflected in the number of calls made during the data 
collection period. A summary of calls made to all sample members is shown in Table 
V.C.2, Overall, 18,974 calls were placed (an average of almost 10 calls per case). An 
average of 4.7 calls were made for locating (including calls to those who were not located), 
and an average of 7.4 calls were made for purposes of interviewing (including calls to those 
for whom no intervic^w or only partial interview was obtained). (It should be noted that in 
this and subsequent tables the call during which contact was made is counted as both a 
contact call and an interview call, but this redundancy has been eliminated in the "total 
calls" statistics.) 

In the total call statistics, the increase in average calls required (with associated 
increase in standard deviation) as level of institution offering increases is important for both 
locating and interviewing. This relationship is most likely related to the increasing 
proportion of students who were still enrolled at each level. Thus, those in four-year 
institutions required more calls to both locate and to complete the interview. As indicated by 
debriefings of supervisors and interviewers, students living in dormitories presented 
particularly thorny problems for locating and scheduling. This involved both the problems 
associated with common "hall phones" as well as sophisticated telephone systems requiring 
entry of student room number (which was typically not available and required other calls to 
dcterniine the "extension"). 

Table V.C.2 also presents call statistics for cases with full or partial interviews. As 
should be expected, these cases were generally contacted in fewer calls and interviewed in 
fewer calls, since calls continued to the non-interviewed cases until the end of the data 
collection period or until it was determined that they were refusals or no longer contactable. 
Again, an increasing number of calls was required as the level of institution offering 
increased, largely related to the difficulty of contacting and scheduling interviews for those 
still enrolled. 

Some relief in effort for the full-scale study can be expected due to more precise 
screening for FTBs using algorithms developed in the field-test and the earlier starting point 
within the 1991-92 Academic Year. Differences in the make up of the full-scale and field- 
test samples, on the other hand, suggest that effort may be increased. For the field test, less 
than half of the sample was selected from four-year institutions, but for the full-scale study 
almost 60 percent of the sample is expected to be from this sector, 

3. Feedback from Interviewers and Supervisors 

Feedback from the human element of the CAT! system is considered quite importani 
for evaluation of the operation. This feedback was obtained in a number of ways. 
Interviewers completed problem sheets for difficulties encountered in completing interviews, 
including: (a) instances where errors in previous '^espouses were delected and had to be 
fora'cted, (h) sus|X'Cted proprammin{^^, t>ranching ancl/or other errors, and (c) responses that 
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exceeded upper limits set by the program. Additionally, all interviewers were debriefed at 
the conclusion of the data collection, as were supervisors and quaHty control monitors. 

Problem sheet reports (a total of 486) were evaluated daily. The majority (over 250) 
of these reports reflected misunderstanding on the part of the interviewer as to what the 
program was to accomplish. These were clarified and a notation made of the situation for 
possible inclusion in the full-scale training. Programming problems were typically corrected 
within 48 hours. In most cases these represented rare combinations of circumstances that 
had not been anticipated. Problems associated with errors detected in previous responses 
were either corrected by the interviewer, or were corrected post-Iioc by project staff (54 
occurrences). In well over half of these cases, the problem was interviewer error and 
suggested additional areas for emphasis in training. 

The programming problems that could not be corrected involved number of jobs 
reported. Fortunately, only two instances of this type of situation were reported (out of 
almost 1,050 cases that completed through Section D of the interview); both of these 
involved a respondent with more than 6 jobs. In both cases this resulted from numerous part 
time and summer jobs held by students still enrolled . Due to the low frequency of 
occurrence and the proposed differential treatment of job data in the full>scale study, this is 
not considered sufficiently problematic to require reprogramming for the full scale study. 

A number of useful comments were obtained from interviewers during debriefing 
sessions, and these are summarized below. A facsimile of the CATI items is in Appendix C. 

Tracing. Interviewers suggested that the ability to move back and forth from 
tracing to interviewing module should be more flexible. They also suggested that 
interviewers be given greater flexibility to move through the available numbers on their own, 
based on new information. The tracing portion of the CATI package will be modified to 
allow inter\'iewcrs to override the ordering of numbers, to allow free movement between the 
tracing and interviewing modules, and to allow records of calls and comments specific to 
each of the available telephone numbers. 

Contacting Sample Members. The following factors were identified as most 
problematic in contacting subjects: (a) currently enrolled students were rarely home; 
(b) computerized dorm phones often required knowing the students room number (unknown 
in most cases); and (c) spring break, exams, and depaitures at the close of the data collection 
period. It was also suggested that the option of breaking off the interview and establishing a 
call back after 45 minutes be discontinued, since it is increasingly difficult to get the subject 
back for the completion. Students currently enrolled will be given priority scheduling in the 
full scale study so that they will be more likely to be contacti^d before the end of the 
institution Ye<ir, The option for explicit offering of breakoff will not be offered in the full 
scale study since analyses of that option (Section VLB) showed no advantages. 
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Gaining Cooperation. Interviewers identified the length of the interview as 
being a major obstacle in gaining continued cooperation. Other obstacles were: 
(a) respondents not having time; (b) respondents not having data to accurately answer 
questions; and (c) respondents not being available for the entire interview in one sitting. 
Interviewers reported that students were motivated by the opportunity to evaluate their 
institutions. This suggests that this be included as a prompt for participation in the full-scale 
study. Interview length sliould be cut substantially (see also Secuon V.E); v/e would 
recommend an interview no longer than 40 minutes on a/erage. 

Questionnaire: Introduction and Section A. Most comments regarding this 
section were focused on the screens involving the worksheets. Since we have recommended 
the discontinuance of worksheets for the full-scale study, these comments are not applicable. 
Interviewers consistently suggested that the informed consent statenv^nt be shortened. 

Questionnaire: Section B. Interviewers indicated that the series of questions 
(B.8 and B.9) about availability, use, and satisfaction with institution activities/programs for 
each institution attended were extremely tedious, particularly for institutions that they only 
attended during the summer between terms at another institution. The full-scale study should 
consider eliminating this question except for principal institulion(s). Interviewers also 
suggested thai raining include empliasis on confirmation of any unusually long term; this 
will be done. 

Questionnaire: Section C. Interviewers indicated that they typically needed 
calculators to help in summing the various components of a student's expenses at institution 
during each term. Hopefully, some of the detail requiring their use will be deleted from the 
final questionnaire. 

Questionnaire: Section D. Major concern was expressed about asking full 
time students about unemployment. This will be corrected for the full scale study. 
Interviewers also pointed out that the questions about summer jobs and jobs held while in 
instituti'jn were entirely too detailed for full-time students; modification of this to reduce the 
number of questions will be explored. 

Questionnaire: Section E. The only comment on this section was that some 
redundancy existed between the section introduction and the first question stem. This will be 
corrected. 

Questionnaire: Sections F and G. Interviewers indicated considerable 
hesitance and offense among respondents with regard to spouse and parental income (this is a 
fairly common reaction to income questions). Modification of the parental income question 
so that it is drivtMi by dependency status will be implemented for the tull-scalc study, and a 
less threatening way of seeking income information will be souglit. 
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Questionnaire: Section The only comments about this section involved 
the fact that students who only plan to attend graduate institution do not necessarily know the 
detailed information requested about the institutions to which they will apply. They 
recommended not asking detailed questions except for those who have actually applied. 

Questionnaire: Section 1. Interviewers obser\'ed that the referent unit of time 
(hours/week) was not sufficient to describe the amount of community service by some 
respondents (which could be "two days a year"). Other options will be explored for the full- 
scale study. 

Questionnaire: Section J. Interviewers recommended only changing the 
wording for the introduction to the section, since it made it appear that the interview was 
completed. This will be accomplished for the full-scale study. 



D. Indeterminale Responses 

Allowances were made in the CATI program to accominodate (both explicitly as a 
fixed response alternative, and implicitly by special keyed entry) responses of "Don't Know" 
(DK) and "Refusal" to any question. Such responses represent indeterminacies in the data 
set and must be resolved by imputation or subsequently dealt with during analyses; 
consequently, they need to be reduced where possible. Refusal responses are generally in 
response to items considered sensitive by the respondent, but indeterminate DK results from 
a number of potential sources; these include: (1) question wording not being understood by 
the respondent (and lack of explanation by the interviewer), (2) hesitancy on the part of the 
respondent to provide "best guess" responses (and insufficient prompting from the 
interviewer), (3) the answer being truly unknown by, or inappropriate for, the respondent, 
and (4) an implicit refusal to answer the question. 

A summary of DK and refusal responses for the BPS:90/92 field test, by interview 
section, is provided in Table V.D.I. Statistics are provided for both the number (and 
percentage) of items in each section in which any refusal or DK response was given, and for 
maximum item DK and refusal rates. Respondent level statistics are computed only for 
individuals completing a given section. 

Overall, refusal responses were given to about 18 percent of the items in the 
interview. This is, however, somewhat misleading, since only 5 unique respondents 
accounted for the bulk of the items with refusals. The actual refusal rates were quite low; 
maxinumi item refusal rates exceeded 1 percent in only two sections of the interview. In 
section G, they were obtained for questions about spouse's salary and actual or expected 
income, respondent's actual or expected income, and household actual or expected income. 
In Section J, refusal rales grc^itcr than 1 percent were obtained principally for items 
requesting telephone numbers. 
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DK responses were ccnsiderably more prominent. In total, over 40 percent of the 
questionnaire items evoked such responses. Again, however, this is somewhat misleading; 
only 20 unique respondents accounted for about a third of the items with such 
indeterminacies, and only about 9 percent of the items had DK rates of 1 percent or greater. 
Nonetheless, the maximum section-level DK indeterminacy rates are sufficiently high to 
warrant further discussion. 

Maximum DK rates were generally quite small in Section A. Only 5 of the 14 items 
with DK responses elicited such responses from more than 2 individuals (0.17 percent). 
Responses of DK greater than 1 percent were obtained only for 4 items (two of which were 
related to receipt of the letter/ worksheet and two of which were the month and year of last 
attending the NPSAS:90 institution prior to July 1988), In Section B, only 23 of the 184 
items with DK responses had more than 4 (0.37 percent) such responses; of these, 1 1 had 
indeterminacy rates greater than 1 percent, all of which were associated with term level 
information (item B7). Eight of these, including the three items with over 3 percent 
indeterminacies, related to items B7.c and B7.e, credits enrolled for and credits earned, 
probably reflecting the problem with interpretation of credits in some proprietary institutions 
(see also Section VI. E). The remaining three problem items involved questions about 
number of courses taken (B7.b) and the nature of enrolled-for credits; again, probably 
reflecting inapplicability of such items for some proprietary institution students. 

DK responses were somewhat more problematic in Section C, but less than half (22) 
of the 48 items with indeterminate responses had more than four (0.48 percent) such 
responses. Of these, 16 items had indeterminacy rates greater than 1 percent and 4 had 
indeterminacy rates of 3 percent or greater. All of the latter items and three-fourths of the 
former were for repe<its of questions about amount of tuition, fees, or other educational 
expenses (items CI and C2) and total financial aid received and percentage of expenses 
covered by such aid (items C6 and C7). Other items eliciting greater than 1 percent DK 
responses were ClO.b (amount owed on postsecondary loans), and the series of questions 
about being a dependent on parents' tax returns (C12.b through C12.e). The dependency 
problem can probably be reduced by probing for parents providing more than half of the 
student's support; other problems probably reflect insufficient interviewer probing for a best 
estimate from the respondent, which will be an issue for training during the full-scale survey. 

The maximum DK rate for items in Section D (work experience) was less than 2 
percent; however, 24 items had indeterminacy rates of greater than 1 percent. These 
questions reflected uncertainties about: type of job, seasonality of job, job duties, type of 
company, dates of employment, salary, hours worked per week, location of work (on or off 
campus), work associated with educational program, amount of training required for job, and 
whether employer provided training. Indeterminacy in these items reflect, in the main, 
inability of interviewers to probe for the correct answer, a matter to be stressed in training 
for the full-scale survey. Sections E and F had such low indeterminacy rates that discussion 
seems unwarranted. 
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Section G produced both the highest indeterminacy rates and the highest DK rates. 
Moreover, the items in this section with high explicit retusal rates (see above) were basically 
the same as those with high DK rates (i.e., questions related to income). This suggests that 
a portion of the don't know responses reflect implicit refusals to provide the response 
(particularly for personal income in 1989-1991 - all with indeterminacy rates greater than 5 
percent . The three other items with indeterminacy rates greater than 5 percent (all actually 
greater than 14 percent) were the questions about household income for the three years. This 
probably also reflects cases in which the sample member really does not know what the 
parental income is, in which case, indeterminacy rate could be reduced by pressing for 
estimates within broad ranges as an alternate way of collecting the information when the 
response to the actual amount is DK. Unfortunately, while this approach may reduce the DK 
rate, it will probably result in increased explicit refusals, since experience has consistently 
demonstrated respondent sensitivity to questions about income. 

DK responses were elicited on all but one of the items of vSection H (Goals, 
Aspirations, and Expectations), and rates were fairly substantial (48 items with DK rates 
greater than 1 percent and 13 with rates greater than 5 percc^nt). Most of the high 
indeterminacy rates are associated with questions about applications to graduate institution 
when the respondent indicated he/she "planned" to apply to graduate institution, but plans 
were not firm. Consequently, the respondent didn't know when the application would be 
made or the name or address of first or second choice of graduate institutions which they 
would apply to. As indicated elsewhere in this report (see Section VI. G, below), this 
situation introduced some problems in on-line IPEDS coding, but is easily handled by a 
screening question asking whether the respondent knows to which graduate institution he/she 
will apply. This also avoids a serious response problem, since the series of questions is to 
determine when respondents start to pl an for and actually begin attempts to gain admission to 
graduate institution. 

DK rates for future educational enrollment plans increased slightly as the lime frame 
expanded; however, the maximum DK rate (for ten years in the future) was only about 3 
percent. DK rates for future types of jobs, however, showed a decreasing trend as the time 
frame expanded, with rates of 5 percent or greater for the first two years and about 4.5 
percent for 5 and 10 years in the future. This is probably due to the fact that for many 
students who plan to l^c in institution during the next year or two, future employment plans 
are probably less certain. Screening questions for sample members planning to be in 
institution at designated times in the future could avoid asking the question for those who 
really don't know the exact nature of their employment in the future while they are still 
enrolled. Also, even though future plans for some individuals are not cle^ir cut, better 
prompting for best estimates by interviewers should reduce the DK rates in this section. 

Only 4 items in Section 1 (Public Service and Voting Experiences) elicited DK 
response rates greater than 1 percent. All such items were related to future plans for voting 
and community service, and should be reducible by better interviewer preempting. DK 
responses to Section J items can lead to problems in future contact with sample me-iihcrs; 
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however, only 14 items elicited DK rates of more than 1 percent; 2 items had DK rates of 
more than 5 percent. In the main, such indeterminacies involved the addresses or phone 
numbers of specific locating sources. The maximum rate, however, was associated with the 
middle initial of the contact person identified in question Jl, which is not considered a 
serious omission, given other address information. The next highest DK rate, however, was 
for driver's license number, which should have been reduced by an interviewer prompt to the 
respondent: "Please get your driver's license and read me the number." The only other item 
(aside from names and addresses) with greater than 1 percent DK rate was the item soliciting 
whether the individual would be at the same address in two years; a DK rate of 2.3 percent 
for this item is considered reasonable. 



E. Timing of Interview 

The time to complete the field-test interview (and various segments thereof) needs to 
be reduced substantially for the full scale study. Timing data were obtained through time 
stamps imbedded in the CATI program at specific points in the interview flow. It was not 
possible to analyze the timing of sections in which subjects terminated the interview, or when 
aberrant timing results occurred. 

Overall interview timing statistics are provided in Table V.E.I. A more detailed 
description of section and subsection timings is included as Appendix C, where two estimates 
of overall timing are given. The first estimate of 55.4 minutes is based on the 423 sample 
members who completed the full interview in one session. This estimate does not include 
those individuals who accepted the interview rescheduling option due to length of the 
interview or those who decided on their own to reschedule the remainder of a long interview 
to a later date. As such, the estimated average time is biased downward from the actual time 
for all individuals to complete the interview. 

The second estimate, presented in Table V.E.I, represents the sum of estimated 
section timing subtotals and is based on data from 1074 individuals. This estimate (overall 
completion time of about 57.5 minutes) is considered more realistic, but is still considered to 
be an underestimate, since it does not reflect timing data from 78 cases completing the 
interview in multiple sessions and does not include section timing data for individuals who 
completed a section in more than one session. Because of the relatively small number of 
cases excluded, it is estimated that the true average time to complete the interview would not 
exceed 58.5 minutes. Overall timing data suggest that interview completion time is 
somewhat less for those in less-than-two-year institutions, probably as a function of fewer 
terms of education to examine. 

The results of the timing runs iind other evaluations suggest that the full scale 
inten'iew should be about 40 minutes. By deleting or restructuring various questions within 
each section, sufficient time savings should be possible. Maximum savings estimates are also 
shown in Table V.E.I, by section and total. It is anticipated that a maximum savings of 
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20.9 minutes could be saved if ail suggestions were adopted. At minimum, over 12 minute- 
could be saved in this manner. Appendix C contains detailed section by section suggestions 
for item deletions or restructuring. 



Table V.E.I. Average completion time and possible savings by section and overall, 





N' 


\verage 
Time" 


Maximum 
Possible 
Savings 


Section A - Introduction and Validation 


598' 


4.94 


1.50 


Section B - Education Experiences 


1,004 


17.58 


6.75 


Section C - Educational Finance 


996 


6.47 


2.00 


Section D - Work Experience 


978 


9.20 


4.80 


Section E - Other Education or Training 


949 


1.63 


1.60 


Section F - Demographic Information 


959 


1.66 


.30 


Section G - Family Information 


948 


3.52 


.90 


Section H - Goals, Aspirations, Expectations 


942 


6.33 


1.75 


Section I - Public Service and Voting Experience 


946 


1.66 


.10 


Section J - Locator Information 


945 


4.59 


1.20 


Total 


1,074 


57.59 


20.90 



' 'iijmber who responded to the section in one scG .ion. 

' Average time in minutes is based on those who completed the ?.ection in one scnnion. 

' This section allowed rhc intorview to be rescheduled lijter, aid hence haJ fewer respondent:, co-p'.e 
section when first started. 
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VL Evaluation of Experimental Conditions and Data Quality 



A. Worksheet Cuudition Evaluation 

Field test sample members were sent either an education worksheet, an employment 
worksheet, or no worksheet, as described in Section Table VI. A. 1 presents the 
interview completion rates for specified subpopiilations by worksheet condition. Wt^rksheet 
condition refers to the experimental group to which the person was assigned. All groups had 
similar completion rates regardless of whether or not a worksheet was sent. Among those 
persons contacted by phone, 81.8 percent of those who were -^ent no worksheet gave a parlial 
or coniplete interview, as did 83,8 percent of those who were sent an employment 
worksheet, and 78.7 percent of tliose who were sent an education worksheet. 

Not all sample members who were sent a worksheet recalled n^eivinj/ it, and not 
everyone who received the worksheet used it. Of the 761 persons who were inicrvicwed and 
had been sunt a worksheet, only 35 percent recalled receiv ing il, and of lho.se who received 
the worksheet, only 37 percent reported using it. Overall, only a small fraction, 13 percent, 
of those who were sent a worksheet acUially used it. An even smaller perce \i had the 
worksheet available during the interview (10 percent of those who were sent one and 28 
percent of those who received one). * 

Table VI. A. 2 i)resehls the meati times in ntinules to tontplele the e(lui*itioii 'A'elions 
and the employment section of the questionnaire by whether or not the worksheet was used. 
One of the hypotheses was that persons who received and used the worksheel would rct|uiiv 
l*,*ss time to complete the applicable section of the questionnaire than those who did not use 
the worksheet. Intereslih''Jy, the op[)osile is true: persons wIk» used the worksheet took 
slightly longer to complete the various sections of (he questionnaire than those who did not, 
although the differences are not statistically significant. A possible explanation is that 
persons more likely to use the worksheet arc those with more complicated and lengthy 
education or employment histories, and these persons would necessarily take longer l(» 
complete the questionnaire. Anolher explanation is that sample members who were 
sufficiently compulsive to um; the worksheet were also compulsive in explaining their 
respi^mses to interview questions. 

There is certainly no indication from these data that the worksheet v. as effective in 
reducing inteiA'iew eonipletiun time: however, this finding must l>e qualified by the fact that 
only a small traction of cases received and used the worksheet or had il available during the 
interview. The underlying logic of the worksheets facilitating the interview seems 
reasonable; however, if these tools are to be used in the full-scale study, il is impenitive that 
better addresses be used and lhat the lead letter stress the importance of having the worksheel 
available during the intcr\'iew. Availability of (he worksheet during the inlerviev/ vnnild iJso 
be lacilitaied by mailing Ihe student Ictid letter closer in time \o the actual mterview, 
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Table VI.A.l. Interview completion rates by wurksliecl euiulition 
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B. Rescheduling Condition Evaluation 



A random sample of i)erMjiis for whom the iiUerviewb \SL-rc taking over 45 minutes at 
the completion of Section D through H were given the option of rescheduling the remainder 
of the interview for another clay or time. (This option was disabled during the last 3 weeks 
of data collection, since rescheduling became a problem at that time.) The majority of those 
given the option (117 of 155, or 76 percent) declined it. All of those who were not given the 
option and all of those who declined the option completed the interview. A small number (P. 
percent) of those who accepted the option to reschedule did not complete tlie interview. 

During debriefing, interviewers Cv .nmented that the option was not considered 
workable. In light of the considerable difficulty of getting sample members to the phone, 
any procedure to allnw a breakoff was considered eounter-prcHluctive. Since there is no 
empirical indication that this option was successful (or even desired by lliose offered it), 
there is no reason to include it in the full-scale study. 



C. licliahility of liasc Year Data 

'Ihe field test design permiiifd two sets of analyses lo assess the temporal stability, or 
reliability ot tield test interview responses: one set of analyses comparing base-year NFSAS 
ics|K>nses and Meld test Ul'S resinmses, and a second comparing HI'S field test lesjxnises with 
a secdiid set of Bl'S res|Kjnses obtained using reinterview i)n)t()cols. 'I his scLiion reports on 
the anaiy?>es coni|)aring base-year NPSAS resjKmses and field test HPS responses, These 
analyses were used to assess relatively long-term stability. The analyses fwused on data 
items that were not exjxvted to change across the time fieriod intervening bLtweeii the two 
interviews, Thus, the analyses are useful for assessing whether interview resi>oiises contain 
portions of measurement error that are unstable over time. For example, large and unstable 
measurement errors might result if resiwndents are inattentive during the survey interviews, 
or if respondents interpret questions differenlty at different times, or it respondents have 
liouble remembering information necessary to answer the questions. Relatively high indices 
of tcm|xiral stability would suggest that the NPSAS base year data and Ihe BPS interview 
ivsptmses are relatively free from large measurement rrrors that vary aiToss lime. Overall, 
eorresiH)iidenees between NPSAS base-year and I5PS field test results indicated relatively 
high long-term reliability in interview lesiMinses. 

In Section A of the questionnaire, the res}K)ndent was asked lo verify whether or not 
cerl.iin demographic data collected in the base year were correct. Table Vl.C.l presents the 
[K'rcent.ige of jwrscuis who re|Kirted that the earlier collected information was not correct. 
Most of these base year demographic data a[ipear lo be qui:'^ ^'liable, 'Ihe high .schiwl 
completion status and the year the jx-rsnn received tl'.eir high sc1uk.<1 diploma, and the 
l^erson's U.S. citi/cnship status were incorrect 1 percent or less of the time; birthday, 
gender, and race were incorrect less than 2 jx-reent of the time; and the Hispanic iivlieaior 
W IS incorrect about } {KMcenl of the lime, 'The leaM reliabi • item was the Hispanic ty|K'; of 
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Table VLCJ. 



Reliability of base year data: Percentage of preloaded demographic 
items in Section A that are change^l in the inter\'ie\v 



Demographic Item 


Percentage Changed 


High School Completion Status (A 19a) 


1.0 


(1.152) 


Year Received High School Diploma (A19c) 


O.S 


(1.131) 


Birthday (A20a) 


1.2 


(1,150) 


Gender (A21a) 


1.6 


(1,152) 


Race (A22a) 


1.2 


(1.146) 


Hispanic Indicator (A2Jaj 


2,S 


(1.115) 


Hispanic Type (A2.k) 


12.8 




U.S. Citizenship (A24a) 




(1,148) 



NOrt; Jf\hic \t. b^r.ed on the total of 1,1f>i? pernor, who cr."f»l ef- :J U'cWon A of the qj-j-.t i ovoi r e, h'iO ha J 
provided ba%e year dito, arw:i for whc-n the que^itior- H:r. fff^jfufiri :»tc. Crrjnt*. of total cri'-os on which the 
percent ogt-s are bnsed are given in parenthcscri. 



lliosc who were Hispanic, about 1.^ pcr<:cirt rcp(ulc(l lhat the Hispanic ivpc fMVcn in the base 
year data was incorrect. 

1). kciiability and Validity K( iiilcrvlcus 

The reliability rc-inlcrview ol tVXTI oiHMMlions involwd 125 rosjH>ndcnls and began 
i»n April 21sl and ended on June ^Hh, a total ol shghlly more tlian scNcn week 'Ihf v.didi(\ 
jK)rtion of ('A TI, involving a separate s;.mple of 75 resjHMidents. began on May lOih and 
lasted about four and a half weeks, also ending on June 0(h. bi both cases of reintervieu, a 
j)ereent.ige of telephone numbers turned bad (4 |KMcenl v\ those in the reli.ibilily sample and 
8 [Krccnl of those in the validity s.Jtmplc) between the time of the initial interview and the 
reinter\'iew {principally as a result oi* the student moving and^or having the phone 
disconnected). Ideally, these cases would liave been sent to intensi\c trace, but in light (»f 
the short time-tramc for lield-lest reintcrviewing. this was not accomplished. Of dio^e 
remaining, full or partial data was obtained from over 91 percent of the reluibitilv 
reinlerviewees and tor almost 01) |vrcenl of the v.ditli's leintcrvicuccs, as sh(»wii in 
Tabic VI. r; J. 
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Response rates to both of the reinterview samples also rcnccted the field test time- 
frame and relatively short times for telephone contacting and interview scheduling!.. In 
addition to numbers going bad, lU of these respondents were not reached for reinterview 
before the end of the study. 

E. Reliability Reinterview Results 

Reliability reinterviews were administered to a randomly selected subset of BPS 
resixmdents to assess the short-term reliability of selected items. Items selected lor reliability 
reinterview were those considered most crucial to the section over the long run, and which 
logically would not change with the passage of time, t orrclation analyses were used to 
estimate response stability across short time frames. Again, analyses generally focused on 
data items that are not expected to change much between interviews to assure that responses 
were consistent. Thus, the analyses are useful for assessing whether interview responses 
contain sizeable measurement errors that are unstable over relatively short time l>ames. hor 



{'able VI. 1). 1 , I'iiial stiitus of reinterview procedures 



( 'atcpory/Subcalcgory 


Reliability Study 


Validity Study 


Number 


Percent 

()(• 
Total 


Percent 
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Total 


Percent 
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.Siiblolal 

NA 


Total .Selected 


125 1 


loo.u',;. 


NA 
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4.0';,' 
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example, unstable measurement errors may result trom iniitcntion, inaccuracy of recall, or 
clifncuHios in understanding" sur\'ey questions. Relatively high indices of temporal stability 
would suggest that the BPS interview responses are relatively free from large measurement 
errors that vary across relatively short periods of time. 

A sample of 125 of those completing the main inten/iew were selected for 
reinterview; they were asked a subset of questions in Sections B, C, and D. The responses 
to some of these questions across interviews are compared in this section. Of the 125 
persons selected to be reinterviewed, 110 gave a complete interview and another 5 gave a 
partial interview. Original intent was to analyze reliability by worksheet condition; however, 
this was not done, because only nine of the 8.^ [Xirsons who were sent a worksheet and 
selected for the reliability reinterview reported using the worksheet. 

Tables in this section report the percentage of (lersons who gave identical answers in 
the two interviews, and the correlation between tlie responses. The correlation is Pearson's 
product moment (r) lor da(a sucli as number ot terms, beginning or ending niDnlhs or year;., 
or dollars; Spearman's rho (/») for data such as rankings; and the phi coelficient {4') lor 
dichotomous (yes/no) data for .selected items. These statistics are based on the 1 10 persons 
who completed both inlcrviews and who answered the specified question in both interviews. 

1 . Te rms at the NP SAS_Sctiogl 

In question 1, Section B, of the mterview, the student was asked to correct or update 
information already on file about terms at the NPSAS .school. Table VI.R.l compares some 
of the final uixlatcd information from the pr(xluction interview with those from the 
reinterview. 

Only 76 percent of the students gave data for the same number of terms in the two 
interviews, although the correlation between the numbers of terms given is quite high (OM)). 
I'hc agreement between the beginning and ending dates for the first terms at the NPSAS 
school was also quite high. Agreement between the beginning and ending dates for the last 
reported term was also high, although lower than for the first term. 

2 . T erms at Q tljer^Sch »Ls 

In quf'Slion 7. of section B. the student was asked to update inlorniation about 
terms at schools other than the NPSAS scIuh.I. Overall, 80 per.sons responded that they had 
no terms at another schtx)!. 6 jxMsons responded with no terms in one interview and at least 
one term in the other interviev. , and 24 {xn.sons responded in Ixith interviews that they went 
at least one term to another schcxil. 

Table VI.H.2 compares the final u|xlated d;ita from the tv.o interviews loi tliose 24 
persons who resix.nded in bou. inlervi -ws that they went at least one term to another school. 
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Agreement was higher for the first term than for the last reported term, and was higher for 
year than fc^r months^ as should be expected. 



Table Vl.E. 1. Consistency across interviews: Terms at NPSAS school (items in B.l) 





Percentage 


Pearson 




Exact Agreement 


Correlation 


Number of NPSAS terms 


76.4 


0,899 


First term beginning year 


100.0 


l.(KX) 


First term beginning month 


100.0 


1.000 


I'irsl term ending yciir 


98,2 


0,868 


First term ending month 


93.6 


0.793 


Last term beginning year 


86.4 


0.871 


Last term beginning month 


86.4 


0.864 


I^ist term ending yeiir 


90,0 


0.867 


Last term ending month 


86.4 


0,891 



NOTE: Statiiaici. arc based on the 110 persons who ccaplctcd both intcrvicwr.. 



Tablt' VI. I:. 2. Consistency across interviews: Terms at other schools (items in H.2) 





Percentage 


Pearson 




lixaet Agreement 


CorrL-lation 


Niimlicr of other terms 


88.2 


0.804 


First term beginning year 


87.5 


0.8^)4 


First term beginning month 


70.2 


0.818 


f'irst term ending year 


87.5 


0.902 


First term ending month 


7,5.0 


0.726 


Ixist term beginning year 


75.0 


0.805 


Last term beginning month 


62.5 


0.566 


Last term ending year 


83.3 ' 


0.756 


Last term ending month 


66,7 


0.4f.7 



h'JTL: CoTpar j i;cnj of bi'girLnin9 a'd cfvJinq ten] djtc:. ji c b^ir.cd on the ZU pori;cr.~. who rcL.p.yidcj in both 
intcrvtcw; that the/ had on? or roro tcrrr:; nt n.nothcr ';-hDr.l, 
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Information About Terms Since February 1989 



Items in question 7 of Section B ask the student about features of the terms of 
enrollment since February, 1989. Table VI. E. 3 compares information given in the two 
interviews regarding the Fir.st and last reported terms for the NPSAS school. Only 68 
percent of the students resp<,)nded for exactly the same number of terms in the two 
interviews, although the correlation between the number of terms reported was high: 0.825. 

Other items compared were the number of courses, the number of credits for which 
the student was enrolled, whether or not the student was working toward a license or 
certificate, and if so which one. and whether or not he or she completed work toward the 
certificate or license. 



Table VI, E. 3. Consistency across interviews: Terms since February 1989 (items 

in B.7) 







Percentage 
Exact 


- 




N 


Agreement 


(Jorrelaliui) 


Number of lerms 


IIU 


68.2 


r-0.825 


First term 

Number of courses 
Credits enrolled for* 


96 
76 


71.9 
68.4 


r- 0.854 
1-0.887 


Working toward license or 

certificate (yes/no) 
License or certificate (which one) 


lUl 

Li 


85.1 
81.8 


(;, = 0.ti52 
'^ = 0.50:^ 


Complete work toward license or 
certificate (yes/no) 




85.5 


r..--().8(>^) 


Unst '1 erm 

Number of courses 
Credits enrolled for' 


97 
78 


68.0 
62.8 


r- 0.7^)3 
r ■0.768 


Working toward license or 

certificate (yes/no) 
License or certificate (which one) 


101 

20 


81.2 
80.0 


(,'. = 0.582 


Complete work toward license or 
certificate fyes/no) 


20 


os.o 


(,V-0.K8(. 


' Ofi^? outUcf ro^nP w:j^ r creed dur- to rofjjrtiny crrih 


tf. ur/Jer di f f t 


( cnt calendar ^-y-t 


\ in tH/' tw.' 



aJninir.trotiC'fv-. 
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Generally, reliability of these data is acceptable, pari cularly for the number of 
courses enrolled in during a term, credits enrolled for, and completion of work on a 
certificate or license. Other information about licenses and certificates are not systematically 
reliable in terms of the 0 coefficients (.49 - .65); however, exact agreements are all 80 
percent or greater. 

4. Satisfaction with School Pro g rams 

In question 9 of Section B, the student was asked to rate his or her satisfaction with 
various services, programs, and features at the NPSAS school. The choices were: 

(1) Very Dissatisfied, 

(2) Somewhat Dissatisfied, 

(3) Somewhat Satisfied, 

(4) Very Satisfied, and 

(5) Not Applicable. 

Table VI.E.4 reports the percentage exact agreement and Spearman*' correlation for three 
school services: financial aid counseling, career or job counseling, and job placement. This 
table is based on those students v/ith a response other than "not applicable." About 65 
j:»ercent of the students gave identical ratings in the two intervif.ws. The correlation was 
liighcst for job placement (0.72), and was lower for financial aid counseling (0.62), and was 
even lower for career or job counseling (0.45). The general low reliability of these 
"nonfactual" items is well known and the results are not particularly surprising. 

5. Financial Aid 

Section C asked the student about educational exjx^nscs. Table VI.B.3 compares 
information reported in the two interviews concerning the amount of financial aid received. 
While exact agreement is not uniformly high, the correlation in the amounts of aid received 
and the amount currently owed is quite high (greater than 0.8). The data for the more recent 
school ye;ir (1990-91) has a higher correlation than for the school year 1989-90, as expected. 

6. Work 1 Experie nce 

Section I) of the questionnaire asked about the student's work expi.^rience^, 
Students are asked aboui all jobs held since February 1989, Ta'Oe VLB. 6 compares data only 
for the first re|X)rte(l job. Salary information was collected but not compared because 
students could legitimately change units. For example, one would need to convert a daily 
salary (with hours worked jxt day, and days worked per week) into a common salary base. 

The job information examined was somewhat less reliable Hum would be desired. Ol' 
particular concern is the fact tlial there was only 60 ixMcent agreement as to the number of 
jobs held since Febru^u'y 1989. Reliability for information about the fiist job held ranges 
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Table VI.E.4. Consistency across interviews' Satisfaction with school programs (items 

in B.9) 





n 


Percentage 
Exact Agreement 


Spearman 
Correlation 


Financial aid counseling 


66 


65.2 


0.616 


Career or job counseling 


58 


63.8 


0.451 


Job placement 


41 


63.4 


0.715 



Table VI.E.5. Consistency across interviews: Financial Aid {Section (') 





n 


Percentage 

Exact 
Agreement 


Correlation 


Total Amount Received for 7/89 - 6/90 


108 


58.8 


r-0.827 


Total Received for 7/90 - present 
(1990-91 school year) 


104 


72.1 


r =0,950 


Owe any money on loans (yes/no) 


110 


90.0 


(/.=0.8U0 


1 Amount currently owed 


105 


66.7 


r=0.851 



« 
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Table VI.E.6. Consistency across interviews: Work experiences (Section D) 







Percentage 








Exact 






n 


Agreement 


Correlation 


Job since Feb. 1989 (yes/no) 


110 


89.1 


</> =0.277' 


Number of iobs ^ince Feb 1989 


108 


60.2 


r=0.745 


First job since Feb. 1989 








Montii Started job 


93 


64.5 


r=0.585 


Year Started job 


94 


73.4 


r=0.864 


Still at job (yes/no) 


95 


86.3 


0=0.670 


Month left job 


60 


53.3 


r= 0.527 


Year left job 


01 


73.8 


r=U.587 


Hours per week when left job 


61 


45.9 


r =0.707 


Hours per week now 


21 


57.1 


r=0.785 



The rclatiycly lOi-^ 0 coefficient rci^uUcd from 7 of 10 people, who were originally report ir-'j no job, now 
reporting a job; this could hnve resulted from a job obtained during the period between first and second 
intf-rvi ew'i , 



fruni .53 to .8b and is jj^ciicrally acceptable. However, to improve the reliability of these 
information items for the main study, we suggest implementing a summary/verification 
screen for listing jobs that is similar to that used for the enrollment data in Section B. 

\, Validation Reinterview Results 

The fiekl test design provided the liasis for two sets of analyses to address issues 
related to response accuracy and validity. One set of analyses explored rcsix)ndcnts' answus 
to items in a validity reintcrview administered to a randomly selected subset of BPS 
respcMidcnts in a follow -up interview. '1 he second set of analyses compared respondents' 
reports of edu.ational ex|X'riences v/ith institutional reports elicited from the original NPSAS 
schools (see SectitMi VL(t). This section rei>orts on analyses of resjXMises to ihe validity 
reintcrview. These analyses were used to identify jwtential sources of response inaccuracies 
and to develop survey methods for reducing or eliminating; iniiccuracies du \ to difficulties 
uiulcrstanding interview questions, recalling the requested information, or ^electing 
appropriate response categories. 

The validity reintcrview protCKol fwused on three major sections of tlie BPS 
interview: liducati(»n hxperiences, P/lucation Financing, and Work Hxperiences (see 
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Appendix C for a listing of all interview items). These three sections were selected, in part, 
because they included particularly difficult comprehension and recall tasks. Thus, it was 
especially important to identify potential sources of measurement error and identify 
alternalive question wordings and question-asking strategies expected to reduce response 
errors. The validity reinterview protocol was structured to follow the BPS production 
interview protocol. The validity reinterview included items from the targeted sections of the 
BPS interview, along with follow-up questions designed to gather information about: 

(1) How respondents interpreted the questions 

(2) How accurately they recalled the requested information, and 

(3) Whether respondents had difficulty selecting descriptive response categories. 

The validity reinterview paradigm is not effective for investigating some sources of 
nonsampling error such as deliberate fabrication or inattention on the part of the respondents. 
Validity reinterview methods were selected based on research indicating that difficulties in 
comprehending questions, recalling requested information, and selecting appropriate response 
categories can have large effects on response and estimation accuracy (e.g., Lessler et al., 
1989; Cannell et al., 1989). 

Validity reinterx'iew follow-up questions were develojoed based on cognitive laboratory 
approaches applied to the telephone interview. Generally, these methods yield qualitative 
icsults that are suggestive of potential error that could reduce response accuracy. The major 
benefit of these methods is to identify question revisions and alternative question-aSking 
approaches expected to enhance response accuracy in the full-scale study. Many of the 
difficulties identified in this section converge with results reported in Section VI. E. The 
validity analyses comparing institutional reports with respondent reports, reported in Section 
VI. G below, give complementary, quantitative validity estimates for a relatively small set of 
interview items. 

Seventy-five BPS resixindents were randomly selected to participate in the validation 
reinterview administered during the last four and one-half weeks of CATI operations. From 
the selected respondents, 62 respondents (82.7%) completed the validation reinterview. 

1. Section B: Fxlucational Experie nces 

In Section B on Educational Experiences, item B.7 requests term-by-tcrm information 
about school enrollment and progress. There was concern that several questions among these 
items were more reflective of respondents working toward specific awards, respondents 
enrolled in schools following September through June academic calendars, and respondents 
enrolled in in' titutions using credit systems not based on counts of contact hours. Questions 
were included in the validation reinterview lo investigate student education goals, and the 
calendar and credit systems that resiwndenls were most familiar with. 
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About 13 percent of the validation reinterview respondents indicated that they were 
enrolled in school between February, 1989 and May, 1991 but that they were not working 
toward any formal award: neither a license or certificate, nor a degree or special award. 
Most of these respondents reported enrolling in school for job-related reasons and most were 
taking courses for credit; however, some represented potential ineligibles or non-FTBs (as 
explained in Section III.D, above). Most of them also reported that they did not plan to 
begin working toward a degree at a future time. 

Subsequent analyses of validity reinterview responses in Section B revealed no 
systematic difficulties in understanding or answering questions among those respondents not 
working toward a formal award. These results reduced concerns that general question 
orientation introduced response errors among these respondents. 

The BPS interview item asking about student classification (item B7f, see 
Appendix C) uses response categories based on the freshman through senior classification 
system used by many four-year institutions, but this question also contains a year-based 
(first-year, second-year, etc.) as alternative v/ording where applicable. About 15 percent 
reported attending institutions using a system other than the two provided. 

The item was intended to cover alternative year-based systems by offering a 
classification or year in each response category (e.g., Freshman or first year; Junior or third 
year). Responses to the validation follow-up questions suggest that response alternatives 
should be made more explicit. Thus, in the full-scale study, the logical "or" structures 
should be replaced with explicit specifications such as Freshman (first year student). 

Institutional differences in student classification systems may also be reflected in 
respondent reports of credits enrolled for. In the validation interview, respondents reported 
the number of credits enrolled for in a given term and the type of credits assigned (see items 
B7c and B7d in Appendix C). Then, a follow-up question asked about the terminology 
students usually used to talk out credits. About 29 percent of the reinterview respondents 
reported differences between the type of credits reported and the terminology used to 
describe course credits. However, among those reporting differences, only 5 gave responses 
to the follow-up item that conflicted with their initial responses. Most respondents reporting 
differences indicated that fellow students used more general terminology (e.g., number of 
courses; course credits) that would be meaningful across different credit systems. Thus, the 
validity reinterview results suggest that respondents' interpretations of the credit system 
categories do not introduce response inaccuracies. 

Items B7i through B7o ask respondents for term-by-term information about degrees or 
awards they were working toward. Results from a clinical pretest prior to the field-test 
suggested that some respondents interpreted questions about educational goals as addressing 
relatively long-term goals. For example, some pretest respondents enrolled in four-year 
universities indicated they were working toward professional or graduate degrees. 
Apparently, the more immediate bachelor's degree was perceived as one step toward the 



VM3 



ERLC 



longer-term professional goal. The validation reinierview included a follow-up question to 
assess the frequency with which respondents adopt the longer-term perspective. 

The BPS production items asking respondents whether they were working toward a 
degree, special award, license or certificate were followed by items asking whether or not 
coursework at the specific institution was sufficient to earn the award reported. Only two 
respondents (out of the 18 who reported working toward a license or certificate) indicated 
that coursework at the associated institute was not sufficient. Both reported working toward 
licenses, which are typically granted through external agencies after schooling is completed. 
Thus, there appears to be little, if any, response error among respondents working toward a 
license or certificate. 

In contrast, 15 respondents who reported working toward a degree or special award 
(42.9 percent) indicated that coursework at the assoc:iatcd institution was not sufficient. 
About two-thirds of these cases represented the sami' situation observed in the pretest clinical 
interviews; namely, that they were "working toward" a master's or Ph.D. degree. 

This finding suggests some measurement error in the responses to school-specific 
degree goals; however, the results do not necessarily imply that there is measurement error 
in respondents' reports of whether they are working toward degrees. For example, 
individuals who report they are working toward "long term" advanced degrees are probably 
also working toward "short term," school-specific degrees. Nonetheles , it is important to 
treat this potential source of measurement error, since any errors introduced at this point in 
the interview may affect responses to several subsequent items addressing field of award, 
completion of work on the award during the targeted term, and whether the award was 
attained. Question wording should be revised for the full-scale stud^ to encourage 
respondents to adopt a short-term time frame. 

Item B2 requires detailed, term-by-term recall and report of term starting and ending 
dates. Research on survey report accuracy suggests that respondents have difficulty 
accurately recalling and reporting on recurring events because it can be difficult to 
distinguish between memories from different occurrences (e.g.. Means et al., 1989). There 
were similar concerns about recall and report accuracy for item Bl 1 which asks respondents 
to make a general report of their grades in coursework between July, 1988 and the present 
(i.e., May, 1991). The latter item may be particularly difficult because it requires recall of 
recurring events and also requires that respondents generate estimates across several terms of 
enrollment. 

The validity reinter\Mew protocol included follow-up items that asked respondents to 
rate their confidence in the accuracy of their ajiswers to the term date and grade estimate 
items. When reporting on term starting and ending dates, 87.1 percent of the validity 
reinterview respondents indicated they thought their answers were "very accurate." An 
additional 1 1 percent of the respondents reported that they thought their answers were 
"somewhat accurate". When reporting on their grades across terms, 71 pciccut of the 
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respondents were conndeiu their responses were "ver>' accurate", and 29 percent were 
contidci.t that their icsponses were "somewhat accmaU-," N.> rcspcHideni rcporieU that ilu-ir 
grade estimates were "not very accurate." 

These results suggest that respondents are relatively confidenl in their reports of term 
dates. In this case, event recurrence may facilitate memory accuracy if the dates arc 
relatively constant across years, because under these circumstances it is not important that 
respondents distinguish separate occurrences in order to generate accurate rei^rts. 
Respondents reported less confidence in their grade estimates. Reports of lower confidence 
in grade estimates may be due to the lower level of precision inherent in the response 
categories. For example, the response categories distinguish "mostly A"s" from "A's and 
B's" or "mostly B's," Given the fairly rough characteri/^ition ol grades sought by the grade 
estimation item, lower respondent conndeiice is neither surprising nor problematic, 
particularly as none of the validation rcinterview resiK)ndents rated their grade estimates as 
"not very accuiate," 

The production interview included a series of items asking respondents to rate 
satisfaction with academic climaie and institution services (item B9). Measurement errt.r 
may be intrcKluced if respondents are asked to report on services not offered at their 
institutions because -espondenls may reinterpret the items as asking about services available 
from smne otli r source thai is unrelated to th(;ir school. Production interviewer training 
emphasized the importance of distinguishing between the "not applicable" and the other 
•satisfaction rating response alternatives. Nonetheless, given that the series of items was 
relatively time consuming to administer ('.ee Section D), it seemed imix^rtant to determine 
whether field lest procedures were sufficient to ensure low measurement error. 

To assess the potential for measurement error, ilie validation reinlerview included 
follow up items explicitly askhig respondents to indicate whether selected services/activities 
covered by the BPS interview were actually offered by respondents' institutions. Scn-'iccs 
were selected for follow-up based on results from clinical interviews and on input from 
NCnS. The results, summarized in Table VI. F. 1, indicated some variation in 'he 
proportions of respondents indicating queried services were not provided by their institutions. 
While only 3.2 percent indicated that financial aid counselling was not available through their 
institutions IfiT percent indicated their institutions did not provide personal counselling 
services. I'or companson purjioses, 'I able VI.F.l also contains the percent of students in the 
production interview respt^nding "not applicable" for the items. "Not applicable" may 
represent a combination of not available and "not used, if available," these latter percentages 
should equal or exceed the comparable percentages for "services not available." In all cases, 
this is clearly the ca'-e. These results suggest that providing both a "not applicable" response 
option and inlei^'iewer training on the importance of distinguishing the "not applicable" 
response alternative from the other satisfaction rating responses was sufficient to ensure 
negligible measurement error attributable to liow respondents interpret the questions and 
response categories. Results reported in Section VI. E indicted that satisfaction responses 
were n-l strongly con /islent across time. The present results suggest that tempttral 
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iiiK.(»nsisk'fHifs arc pn/pbablv woi aHribuidblc lo ifKunMMcnt question inicr];rctat!on. based on 
valiilalion reintervievv results, it suoins more likely that incon-;istencies are clue to variability 
in resiXHideiU iwrccptions ol' satisfaction acioss time. 

Additional questicms were included in the validation reiiuerview to assess how 
respondents interpret frequency response categories associated with use of institutional 
services (Question B12-B14). Response categories used were "never", "1 lu 3 times", and 
•4 or more times," Measurement errors would be introduced if respondents differed in terms 
of how they interpret a "time." Follow-up items were ou.:igned to determine whether 
respondents were eslimatinj.^ individual sessions, related sets of sessions such as a single 
application for financial aid, or something else. The results are stmimarized in Table 
Vl.l\2, and it is dear that resiKindents reiK)rted different interpretations of the frequency 
rcs|Hiusc- categories. Reix)rts of respondents' interpretations were particularly equivocal lor 
the item about financial aid counselling, whtMv 57,7 p^^rceni of the reintcrview res|H)ndenls 
rejxirted interpretations based on individual sessions and 423 percent reported interprelatinns 
in terms of number of financi:il aid applications. To the extent that respondents si>cak with 
financial aid counsellors multiple times for a single application, the frequency estimate for 
financial aid counselling will contain measurement error. Based on validity reintervievv 
results, it is expected that measurement error can be reduced in the fuU-suale study by 
rewording the questions and resix)nsc categories to explicitly ikfwu^ frequency terms that are 
used. I'or example, 

...how frequently did you receive financial aid counselling? 

( 1 ) Never 

(2) 1 to ^ sessions (or 1-3 sessions per term) 

(^) 4 or more sessions (or 4 or more sessions per term) 



Table VI.I\1 . Percentages (»f respondents reporting activities and ser\'ices not 

sponsored by institutions 



Activity or Service Not Provided 


Percentage of 
Resix)ndents^ 


Percent Indicating Not Applicable 
in Production Interview^ 


Financial aid counseling 


3.2 


31.9 


Personal counselling 


16.1 


46.9 


Job Placement 


12.9 


31.1 



Sascd on oil ci-os ct-T^jlcting Srctiofj B (M 1,081); the ftrtit four entries represent responses of never 
used, the last three represent rcsponpcr, that service was not available or never uj>ed. 
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liibtc Vl.l'.J. l*erccntagc ot rcsptifuicnts rqxirting alternative inteq^rotations of 

Ircquency response categories 



1 

Service 


Percentage of Respondents Reporting Each Frequency 
Interpretation 




Individual Sessions 


Altcniative Interpretation 


Instructing or tutoring^ 


72.0 


28.0 


Financial aid counselling'' 


57,7 


42.3 



H urrbf.' r of r e porvi^jn t wj ^; » 



Items Br2 through B14 of the production interview are included in the UPS interview in pari 
because the data arc needed for other Department of Hducation studies. Therefore, wording 
revisions for tlic lull-scale study will be made only after consulting with appropriate project 
staff. 

2 . Section (!: Kducaiipnal Financing 

I'he HPS production interview asked respondents to estimate tlie amount spent 
on tuition and fees, and the amount spent on educational expenses for each term of 
enrollnienis. Based on concerns about the accuracy of respondents* reports, the validity 
reinterview protocol included follow-up questions to get information on respondent 
perceptions of response accuracy and to determine whether accuracy can be improved 
through the use of memory cuing methods. 

Item CI asks respondents tor term-by-term information about amounts spent for 
tuition and fees. The validity reinterview included a follow-up question asking respondents 
to rate their confidence in the accuracy of their answers. Among t^ reinterview 
respondents, only 52.4 percent reported they were confident their answers were "very 
accurate." Most of the remaining respondents indicated that their responses were "somewhat 
accurate," although 1.6 i>ercent reported that their responses were "not very accurate." 
Thus, a relatively large portion of respondents report relatively low confidence in their 
estimates of tuition and fee amounts. 

Given relatively low confidence in reports of amounts paid, we wanted to determine 
whether accuracy could be improved by using memory cuing methods (e.g., Loftus & 
Marburger, 1983). Memory cuing methods are designed to remind respondents of things 
they might otherwise forget to take into consideration as they recall information. 
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I'or example, atter giving aii initial c^iiinatc of luilion aiid fct*s, rcs[x>fulenls were 
asked to indicate whether their institutions charged student activities fees, laboratory fees, 
athletic fees, or supplies fees, among others. If the listing of fees reminded respondents of 
fees that were left out of initial estimates, then estimates should be less accurate when 
formulated before the cue list is administered and estimates should be more accurate after the 
cue list is administered. The effectiveness of the memory cue strategy can be evahiated by 
asking respondents whether they would revise their estimate of tuition and fees after 
responding to the cue list of types of fees. 

Memory cue methods were tested for several items on education financing, including 
tuition and fees, educational expenses (item C2), total educational expenses (item C4b), and 
total tmancial aid (item C6a). In the validity reinterview, the resi>ondents were also asked to 
validate their total ex[>enses (the sum of CI and C2) as an additional cue. It was exix:cied 
thai respondents would revise their estimates of ed\icational financing amounts if the memory 
cue method is effective in enhancing report accuracy. 

The memory cue results are summarized in table VI. F. 3. Very few respondents 
revises:! their estimates of total expenses or total financial aid, and the magnitudes of revision 
were negligible. The few respondents who reported that revisions were warranted were 
unable to provide estimates that they thought were more accurate, larger proix3rtions of 
resix)iidents revised their estimates of tuition and fees (11. 3 percent) and educational 
expenses (12.9 percent). However, the magnitudes of the revisions remained relatively small 
and did not exceed two standard errors. In summary, the memory cue method was not 
particularly effective in enhancing response accuracy. 



Table VI. F. 3. Percentage of res{wndents who revises quantitative reports after 

memory cues and mean absolute difference between initial and revised 
reports 



Estimate 


Percentage Who 
Revise Estimate 


Mean Absolute Difference: 
Initial and Revised Estimatal^ 


Tuition and fees 


11.3 


$8,59 (5.54) 


Educational expenses 


12.9 


$34.'/^ (18.78) 


Total expenses 


1.7 


$0.00 


Total financial aid 


0.0 


$0.00 



standard errors are given in parent'ieses. 
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I'he validity reinterMcw piodHol uh-<I a M.von(l cxiXTiincnui inciliLHl to test rcH^Misi 
accuracy. Using decomposition slratCL-y, rcsix)ndcnts were asked to estimate components of 
educational expenses in addition to aggregate amoimts. If component estimates are more 
accurate i m aggregate estimates, then it should be possible to obtain reasonably accurate 
eslimales of educational expenses by summing the separate component estimates. 

I'or example, respondents were asked to give aggregate estimates of total financial aid 
received in a specific yeiir. Then they were asked to give component estimates of aid 
received from sixicifie sources such as grants, scholarships, or federal loans. It would be 
expected that the sum of the component estimates would differ from the aggregate estimates 
if the decomposition strategy is e .ectivc in enhancing estimation accuracy. The mean 
absolute difference between the sum of comix)nent estimates anil the total aggregate estimate 
gives a measure of the effectiveness of the decomiKisilion strategy in enhancing accuracy. 

The validation reinterview implemented decomposition estimation strategics tor items 
on educational expenses and on total financial aid. Comparisons of estimates under the 
aggregate and the decomiwsition question-asking strategies are summarized in Table VI. r. 4. 

In the case of the financial aid estimates, the mean absolute difference was quite small 
relative to the magnitudes of the estimates. However, m the c.isc of the educational expenses 
estimates, the mean absolute difference is relatively large, representing 27 jx-icunt of the 
average of the two estimates. In neither case, howevei, did the mean difference exceed two 
standard errors. Nonetheless, the validation reinterview results suggest that dect>mp<xsition 
questioning approaches may reduce measurement error for this item (and ixirhaps otiieis see 
also the reliability study results in Section VI. E). Recognizing (his potential for error, 
checklists were developed and used in the production interview by interviewers for the 



Table VI. F. 4. Compati.sons of numerical reports under general estimation and 

decomposition question-asking strategies 



Item 


General Estimate 
Mean' 


Decomposition 
Mean' 


Mean Absolute 
Difference' 


Education expenses 


$787.31 
(183.60) 


$703.24 
(138.99) 


$106.78 
(68.11) 


Financial aid 


$2,672.93 
(375.. -^2) 


$2,464.60 
(440. ')8) 


$24.12 
(14.5.3) 



StflixJarcJ errors ore given in p:ircnthcf.cs- 
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educalioruil cx;.vn^es question (Ihe most discrepdiil o^*! J finite chitt^*;c) iluu included all c*f llic 
elements used in the validity reintcrvievv question. Continued use of Ihe checklist is 
recommended for the full-scale study rather than the programmed cues. 

In addition, in the full-scale study, response accuracy might be further enhanced by 
preloading tuition and fee information for all institutions during IPRDS coding look-up. The 
loaded cost data could be used as prompts for individuals reporting tuition and fees. 
Depending on accur<j,;y of IPIiUS tuition and fees information, the Il'LDS look-up niighl be 
substituted for resiKjncleiits* estimates of tuition and fees. 

3. >Sect ion D: Work llxpcrienccs 

'ITic HPS production inler\Mev; protoc ol included items asking for detailed 
informalion about each job hfld since February, 1080, including job Martin[^ and endinj' 
dates, starting and ending saK>ries, and average hours worked [>cr week, among other things. 
The validity reinterview was structured to focus on one job: the Job held for the longest 
pcrio<:i of time. In the validity interview, items on job starting and ending; daf^^s were 
followed by probe questions asking respondents to rate confidence in their responses to the 
starting and ending date items. 

Confidence rating results were similar to those obtained for reports of school term 
starting and ending dates. Respondents were generally confident in the accuracy of their 
reports. Eighty-three percent of the validity reinterview respondents reported confidence that 
their date responses were "very accurate." and 17 jxTcent reported confidence that their dale 
responses were "somewhat accurate." No respondent reported that Job starting and ending 
date responses were "not very accurate." 

These results are consistent with expectations that respondents should have relatively 
little difficulty recalling information about non-recurring events. The correspondence 
between respondents' confidence ratings and expectations based on cognitive models of 
survey response processes suggests that respondents gi^ ^ reasonably accurate responses of 
job starting and ending date. Item revision seems unnecessary. 

NCES project sijff identified a second validation issue in Section D, related to the set 
of iteins asked of respondents who reported at least one time period when they were 
simultaneously enrolled in school and working for pay. In the BPS interview Section D: 
Work Experiences, respondents who reported a time during which they were simultaneously 
employed and enrolled in school were asked to select a response category that characterized 
their role at that time (item D2I). i-ive response categories were developed to indicate 
whether n ,)ondctits perceived niemselves primarily as students who worked or as employees 
who attended school. The resp)nsc categories also distinguished alternative purposes for 
attending school and for employment. In the validation reinterview, a follow-up question 
gave resp<:)ndents an opportunity to indicate whether the response categories were adequate to 
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describe respondents' [x;rccplions and eircuinsUmccs. KcspuiuieiUs Tusl sclcclcd a wW 
descriptor and then indicated whether the descriptor was adequate. 

Most of the forty-two reintcrview respondents who reported a i:^riod during which 
they were employed while attending school indicated that they viewed themselves as students 
who worked to pay for educational expenses or to earn extra spending money. Twelve 
jiercent (a total of 5 respondents) indicated that the response categories were not completely 
adequate. Respondents' open-ended reports suggested that the source of difficulty was not in 
the student/employee description but exclusively in the "puipose" descriptors. The most 
frequent source of difficulty was in interpreting the distinction between working to pay 
educational expenses and working to earn extra spending money. These problems are 
relatively minor, given the overall intent of the question to determine the major descriptor 
(student or employee); however, the results suggest that the que.slion be worded to emphasi/e 
selecting the "best" descriptor. Optionally an "other specify" optioji could be proviJiM for 
"student" and "employee" main descriptors; however, this runs the risk of contaminating the 
major descriptors, which is not desirable. 

In summary, responses to validation reintcrview follow-up questions indicated several 
differences in understanding and interpreting interview questions. Response categories 
should be changed to reduce potential measmement error where the analyses suggested. 



G, Institution Response Vaiidation 

The N1\SAS:90 school provided data on whether or not the student v/as currently 
enrolled, and on whether or not the student completed a school program and received a 
degree, diploma, certificate, or license. A comparison of these data v/ith those provided by 
the student during the inter\'iew is given in Table V;\G.l. About 92 percent of the students 



Table VI.G.l Institution response validauuu: Match of current enrollment and program 
coniplelion reported by th.^^ respondent compared witti that reported by the 
ini:litution 





Pcjcentage 
Agreement 


Phi 
Coefficient 


Cuncnt Enrolifiient 


91.6 


0.820 


l-rograni Completioi) 


84.2 


0.609 



KOTt: Tabic ir. baucd q'a the 9'dO p-jroons with cn\ instUution form uho also coffpleted section B of the 
quest iW(n?;ire. 
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.iiul Uicir NI\SaS tA.*lux)l ucrc ii^ a^UH;Mnent as to whcilu^-r or nui ihc student was ciiircntly 
enrolled, and 84 percent were in agreement as to whether or not the student had completed 
the program at the NPSAS school. These validity coctTicients should be considered lower 
bound estimates, due to the time difference between the collection of institutional data and 
student interviews (during winch time enrollment and completion status could have 
legitimately chanped). 

H. On-Line and Post-Hoc Coding 

A niunber of items administered during the inter\'iew required open-ended answers 
and some form of coding. In addition to the "other specify" items, principal among these 
were: (1) items related to major course of study and area of certification/endorsement 
(i- quiring C\V ecKhng); (2) information about employer and occupation (requiring industry 
and occupalion- I & 0-codinp); and (3) names of institutions attended or planned to attend 
(requiring IPEDS e(Kling). Original plans had called for autocoding of these items following 
collection of data, to reduce respondent burden during on-line coding. 

Generally computer-driven expert coding is a less error-prone procedure than on-line 
coding by "non-experts"; however, on line coding assisted by computer driven expert coding 
provides an opportunity for respondent clarification of questionable responses, which could 
actually improve the overall quality of co<led data (by eliminating post hoc uncodeahle" 
cases). Consequently, on-line IPEDS coding was tested during (he field test. This coding 
used as a base dictionary the 1989-90 IPEDS file.* The dictionary was sorted and 
searched, by state and city (jxist office) within state rolher than by institution name (due to 
the potential for abbreviation--e.g., USC-or alternate wordings/spellings of institution 
names). 

Appropriate (standardized and correct spellings oO city name and state abbreviation 
were, of course, central to the success of this approach. These features were emphasized in 
interviewer training and procedures to handle common errors were programmed into the on- 
line c^KJing routine.' Once institution name, city, and state were keyed, all postsecondary 
institutions in the city were displayed on one or more screens and the interviewer chose the 
correct institution. The chosen institution and the original school name typed by the 
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This flic was modifier! to include cross listing of schools identified to have both a "nominal" and "usual" poht 
office address; for example, the University of Notre Dame is listed in IPEDvS under the nominal post office 
Notre Dame, Indiana, but was cross-lisled under South Bend. Special considerations were aUo made for 
multiple listings of the same school name in the same location (typically proprietary schools with more than one 
branch in the same city); special c(Kles were assigned and street addresses collecled when such cases were 
encountered (for use in subsequent coding). 

Stale abbreviations were checked to ensure they were a valid abbreviation and feedl-ack of full state name was 
provided to interviewer for verification. Whtn cities wvr;- not found, interv icwers had the option to reenter city 
or to try all cities in the state with the same first three letters. 
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nUerviewcr were then shown to the intcrvitwer for veriTKMlion. The prwedurc vsas used to 
code undergraduate institutions attended since the NPSAS:90 data collection as well as 
graduate schools students had applied to (or intended to apply to). A quality control random 
sample of 100 institution name responses was identified for recoding by an expert coder. 

Generally, the procedure was quite successful. No serious problems were reported 
during interviewer debriefmgs and neither supervisors nor project staff who monitored 
interviewers observed difficulties. 

For undergraduate schools, 78 percent of those identified were coded on-line and the 
eritimated celling error rate (from a quality control sample of 41 undergraduate schools) was 
nil. Major reasons for not being coded on-line were: (1) improper identificalion/entry of 
sclux:»l name; (2) wrong city identified (typically representing identification of schools as 
being in a large city when they were actually located in a suburb of that city); and 
(3) inability of interviewer to locate the school from the list provided (interviewer error). In 
subsequent expert coding, all but 12 of the 76 uncoded schools were appropriately coded. 
Three schools missing names and three in foreign countries were not coded; however three 
of the 9 schools not listed in IPEDS were subsequently identified from more current IPEDS 
information. In total 96.5 percent of the undergraduate schools were appropriately coded. 

Vor graduate schotjls, the on-line coding success appears, at first blush, to be 
considerably less effective; however, closer examination reveals the reason for this 
anomalous result. Almost three fourths of the non-coded graduate schools were missing a 
school name. This resulted almost exclusively from students who stated that they "planned 
to apply to graduate school" but did not yet know to which school they would apply, 
resulting in a "don't know" response (which of course could not be coded). Interviewers 
suggested such ca.se be screened out in the full-scale study. (This can be easily accomplished 
by a short screcner question.) If these cases are excluded, 84.3 percent of the graduate 
schools identified by name were coded on-line and al] graduate schools were ultimately 
coded. 

Excluding the "don't know" schools, the most prevalent remaining problem in on-line 
coding of graduate schools resulted from respondents providing school name in abbreviated 
(or out of order) form (e.g., one interviewer did not recognize that UCSB was University of 
California, Santa Barbara; another was not willing to equate "Georgia University" with 
"University of Georgia") or by identifying a subunit of a school (e.g., "Fuqua School of 
Business" which is actually a school within Duke University). Such cases were ultimately 
coded with appropriate IPEDS codes. 

Four of the 59 graduate schools in the quality control sample were incorrectly coded. 
Two of these were due to wrong city identification (University of California San Diego was 
identified in San Diego rather than La Jolla, and interviewers chose San Diego University); 
one was a bad choice of two options, given two similarly named institutions in the same city; 
and the final was interviewer carelessness (interviewer picked the school immediately 
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preceding the correct school on the Iisting--aml obviously lailcd lo nolo, or responded 
incorrectly to, the provided verification screen). Subsequent routine checks of the data 
revealed six additional improperly coded institutions that were appropriately recoded. 

The overall coding error rate of 4 percent is higher than would be desired, and 
additional effort will be needed in training for the full-scale study. Additionally, all 
identified cases of schools in small suburbs of large towns have been cross listed in the large 
cities also. Nonetheless, the overall success of the on-line coding was quite encouraging, 
suggesting that on-line IP12DS coding as well as on-line Industry and Occupation Coding and 
CIP coding can be effectively used in the full-scale study. 

Post hoc CIP and I & O coding have not been completed at this writing; however. 
(.'valu.Uion and rccoding of "other specify" coding has been accomplished. The "other 
specify" items yielded sonic additional categories of responses occurring with sufficient 
frequency to warrant creating separate response alternatives and the exercise did reveal a 
number of questions that require reworking to avoid ambiguity in the desired response. In 
total, better than half (637 of 1,185) of the "other specify" responses cculd be upcoded to an 
existing response alternative. The majority of these were incorrectly given as "other" due to 
carelessness or lack of thought on the part of the interviewer and/or respondent. Potential 
additional response alternatives are indicated in Table VI.H.l. 

The most problematic questions identified through examination of "other specify" 
items were those asking for credit hours (B6c, B6f, B7d). The questions asking about other 
source of support (C9h), and the questions about perception of individual status while going 
to school and working (D21) were also somewhat problematic. Most of the responses to the 
other type of credit specification were too vague to upcode. Part of this is due to oroadly 
varying definitions of credits in proprietary schools, but other problems seemed to be related 
to getting the resp<;)ndent to think about registration periods, grade-card periods, or about 
how often he/she pays tuition. In addition to greater stress on these quesfions during 
interviewer training, an available option is to pick up calendar system as part of the on-line 
IPEDS coding and ask for verification (or for the information if IPEDS coding is not 
completed on-line). 

Question C9h is intended to solicit "non-Financial-Aid" support from personal or 
family loans, savings, and work. Many individuals reported GSL and Perkins loans as 
"other" loans here. A change in the question stems to focus on assistance from family, 
friends, or personal savings and greater emphasis on intent of the question during interviewer 
training should eliminate this problem. 

Question D21 is asked of students who both worked and attended school and is 
intended to determine whether the individual perceives himself/herself as principally a student 
or principally a worker. The programmed rule for asking the question was flawed and a 
number of students were asked the question when all their work was between spells of 
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Table VI.H.l. 



Putential tor additional response alternatives 



Tntprvipw Ttpm^ 


Potential Additional 
rvc5>poribc Aiiernauvcs 


Comments 




till r^lf l\'f^r D r/^\/1 /^lo/^l T-Irtii (.•tnr* i\v\r\\\\A\w\n 

miipiujfwr t roviutu nousing (inciUQing 
military) 

In house or apartment with friends 


Need to ask it 
included in 
educational costs. 


C5e 


Benefits from parents' employer 




C8b 


Did not attend the school 




C9h 


Personal Bank Loan 




D12b, D13b 


Per/unit or piece work, commission unit 


Will require 
estimate of per 
hour or per 
month income. 


I4d 


Club or job requirement 




J2b, J5b 


Uncle/Aunt, Grandparents 





See Appendix C. 



schooling. Consequently they answered "Other: I was never working while in school". The 
rule and wording of the question need to be modified for the full-scale survey. 



I. Siiniinary of Fiill-Scale Plans 

A number of suggested modifications for the full-scale study have been advanced in 
this report. These are summarized below by topical area. 

Plans For Full-Scale Survey Locating. Plans for the locating task for the full-scale 
BPS survey are derived directly from statistical results of the field test combined with 
research requisites. There are two of the latter; 1) a letter in advance of the attempt to 
interview must be sent to every student, and 2) the enrollment status of students will be 
required for sample weighting. These two requisites, in fact, have been employed to 
advantage in the schedule discussed below. 



In the tield test, 44 percent of tlie numbers at which s'.uienls were contacted were 
numbers preloaded from the NPSAS files. The task, then, is to order requests for updates/ 
confirmations to be most advantageous in productivity, reliability, and cost. One factor to be 
considered in student mailings is the desirability of delivering the information as close to the 
time of interview as possible to avoid the student putting it aside and forgetting about it. 

Another factor is the availability of computerized postal service updates. This service 
will provide current addresses (according to postal records) and phone numbers for all 
students, parents, and others if the adaress provided to the update service is current within 
the last three years. This ser\'ice should be tested for usefulness in the full scale survey. 

From the mailnuts conducted in the field test, the most cost-effective source, 
considering prcxluctivity, reliability, and cost, was the parents. The second most cost- 
effective source was the student followed closely by the relative/ friend (other). The 
institutions were the least cost-effective. 

Based on the above considerations, we plan the following mailout schedule. 

1. POSTAL UPDATES. All available student, parent, and other locator information 
should first be sent for postal up<lates. This should take place the first week in 
October, 1991. 

2. PARENTS. Requests for updates/confirmations should be mailed to all parents 
included on the locator file. According to the file for the full-.scale survey, if both 
parents are named at the same address, the request should be made to both. If two 
parents are named at separate addresses, the request should be made to the mother. If 
one parent is listed, the request should be made to that parent. The mailout should 
take place in October, 1991. 

3. FRIENDS/RELATIVES. If no parent is listed, the request should be mailed to 
the "other" if listed. The mailout should coincide with the parent mailout in October, 
1991. 

4. STUDENTS. The mailout to students should be delayed until January 1992. 
This permits updated or confirmed addresses received from parents or "others" to be 
used for the student mailout. The benefits are two-fold: the probability of delivery to 
the correct address increases, as does the probability that the student will receive the 
information and remember it when contacted. This should result in an increase in 
reliable contact numbers. Student updates that are not received in time for delivery at 
the start of CATl mterviewing can be a number one priority prior to intensive tracing. 



5. INSTITUTIONS. The institutions should be asked for less information. Four- 
year institutions should be asked only for enrollment status. The letter will make it 



VI-26 

.^4 



clear that it is the intention of sponsors of this study to reduce the burden to the 
institutions to a minimum. The coordinator will be asked to provide the current 
enrollment status for each of the first time beginning students who participated in the 
survey in 1990 (to be used for weight adjustments and for scheduling priority, see 
Chapter V). If a student cannot be located by any other means, the coordinator could 
subsequently be asked to assist us by providing locator, transfer, and/or employment 
data. In this way, most schools will not be asked for any locating information. 



Procedural Changes. In this and previous chapters, results were presented which 
suggest dropping several experimental procedures that were tested in the field test. 
Specifically, the explicit option for remailing should be dropped, since it unnecessarily 
increased interview administration time and completion rates; if the respondent specifically 
slates refusal to continue without a letter, tiien allowances must be made for such a 
remailing. Similarly, the worksheets used in the field test were rarely received and less often 
used, and the time required for determining receipt and use of them can be eliminated from 
the administration time. Mailing of the student lead letters should be delayed until better 
addresses are obtained and to a point closer to the actual contact for interview. 

Providing respondents an explicit option to break off the interview and schedule a 
callback also proved to be counterproductive in completing interviews and should be 
dropped; again, allowances should be made for such contingencies, but the specific option 
should not be presented. 

The full-scale CATI data collection should begin earlier in the year than in the field 
test, and the data collection period should be extended; the current schedule calls for 
initiation of the process in early February with 20 weeks of operation. Scheduling priority 
should be given to students who were sampled from proprietary schools and to students still 
enrolled in 4-year schools. 

Also, the time consuming operation of manual sorting of parents into specific 
"mother" and "father" fields will be more efficiently accomplished during the CATI 
interview, where cases are already being dealt with on an inr^'^'Mual level. 

System Changes. Few changes are needed for the FICS and CLIM record keeping 
and data management systems, beyond relaxing some of the overcontrol that v/as initially 
built into the FICS system. No major structural changes were suggested for the interview 
administration module (however, content and organizational changes within the interview 
were suggested) or to the associated modules for scheduling (except for imposing additional 
priorities) and performance monitoring. 

Greater use of on-line coding, specifically in the areas of TIP coding and SIC/SOC 
coding seems to be appropriate. Restructuring of, and clianges to, the locating module of 
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CAi'i 'S clearly indicated for efficiency and ease of operation; these should maintain program 
control but provide options for interviewer override of the controlled sequences. Also, more 
detailed record-keeping of comments will be allowed. 

Training Changes, A number of issues related to modifications of training emphasis 
during full-scale operations resulted from debriefings and problem sheet analysis. The most 
salient of these involve additional training in the importance of data collected for SIC/SOC 
coding (and equally importantly for CIP coding of course of study). Also special training 
sessions devoted to the use of special summary screens was indicated. In light of the results 
presented here, the time for full-scale training will be increased to 2 and a half days. 

Interview Content and Logic Changes, Valuable suggestions for changes to item 
wording and logic were identified. Also the need to shorten the length of time required for 
interview administration and to better gain cooperation from sample members was pointed 
out in Sections C, D, and E of Chapter V. 

Some time gains can be achieved by tightening some transitional screen wording or 
through better use of logic chains. However, to reduce administration time to a reasonable 
bngth will require elimination of some of the least essential (or least valid) data elements (or 
a restriction of the time periods or schools for which they are obtained). Major savings are 
only possible in the educational experience, educational financing, and employment 
experience sections. As principal areas for reduction of time in the Educational Experience 
Section, we recommend reducing the information on school climates and services or 
restricting these questions to principal schools. Also, consideration should be given to the 
need for all of the information now collected for each term in which the student is enrolled. 

To reduce administrafion time in the Educational Finance Se^.tion we recommend 
collection of expense and aid data by academic year (within school) rather than by term. 
Also, to the extent possible, use of extant data from IPEDS to estimate expenses should be 
considered. 

The Employment Experience Section represents a major area for savings in 
administration time. A great deal of detailed information was collected on summer jobs and 
jobs held while in school that have very little relevance to the sample members' .planned 
career work. We recommend reduction in the amount of detail requested about such jobs. 
Modifications to the selection of individuals for whom unemployment questions would be 
asked are also recommended, as is dropping questions about "starting" work hours and salary 
(and relying on final hours and salary). 

Elimination of the Other Education Section is also a possibility; however, if retained, 
we recommend a restructuring to more general questions rather than detailed queries about 
every course or program of a given type. Other minor time savings changes to other 
sections were recommended, including: (a) elimination of some of the detail requested about 
spouse's/partner's job in Sections F and G, (b) reduction of the number of windows in which 
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plans for education and occupation are collected in Section H, and restricting occupational 
plan questions in remaining future time points to those individuals who do not plan co be in 
school at those times. 



Reliability/Validity Plans. Tlie validation reinterview results lead to six sets of plans 
designed to decrease measurement erior and improve the quality of BPS data. 

Questions on student classillcation and enrollment credits could minimize orientation 
toward one type of student or institution, (e.g., response categories for student classification) 
through more explicit wording. 

For items dealing with scnool sponsored services, it is important to include explicit 
responses indicating whether services are available at the institution and to train interviewers 
to distinguish "not applicable" responses from other response selections. Both mechanisms 
for reducing measurement error were implemented in the field test. Validity reinterview 
results suggest the mechanisms were effective and they should be incorporated in the full- 
scale study. Also, queries about school services should be tailored to the type of school 
being discussed. 

Some measurement error Is suggested for the item on working toward a 
degree/award, due to an ambiguous frame of reference that does not clearly distinguish short 
and long term goals. This question should be reworded to clarify the frame of reference. 
Other items should also be examined for instances in which question frames of reference may 
be ambiguous. 

"Number of times" is somewhat ambiguous. Therefore, response categories may be 
subject to different interpretations, yielding increased measurement error. The response 
categories or the question stem should be reworded to provide clearer definitions. 

Respondents who are simultaneously enrolled in school and employed seemed to have 
little difficulty selecting either "student" or "employee" as their primaiTy role; however, 
students who worked had some trouble discriminating among their reasons for working. 
This is not considered a serious problem. However, the question !:,hould be reworded to 
stress which category " best " identifies the sample member. 

Enhanced accuracy for reporting quantitative information can be maintained by 
continuing to use the interviewer prompt checklist for the most troublesome educational 
expenses, NPSAS:90 and IPEDS data may be useful as additional prompts for tuition and 
fees estimates. To the extent thai such cues and strategies can be incorporated, it would be 
useful. 
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Appendix A 



Student Prenotification and Tracing Materials 

Introductory Letter from U*S* Department of Education Official 
BPS Study Leaflet (to be enclosed with prenotification letters) 
Parent Tracing Letter 
Directory Update Information - Parent 
Friend/Relative Tracing Letter 
Directory Update Information - Frieni/Relative 
Student Prenotification/Tracing Letter 
Directory Update Information - Student 
Worksheet 1 - Employment History 
Worksheet 2 - Education History 



Institutional Forms and Associated Correspondence 

Administrator's Prenotification Letter 
Institutional Coordinator's Prenotification Letter 
Institutional Coordinator Tracing Letter 
Guide to Completing the Administrative Information Sheet 
Administrative Information Sheet 
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U.S. DEPARTMENT OF EDUCATION 
OFFICE OF EDUCATIONAL RESEARCH AND IMPROVEMENT 



NATIONAL CENTER FOR EDUCATION STATISTICS 



Dear Student: 

The National Center for Education Statistics (NCES) has a mandate from the Congress 
to provide policymakers with information about the quality of education in the United 
States. This includes information about student access to and persistence in 
postsecondary education. It also includes information about students* experiences as they 
enter the workforce. NCES has authorized Research Triangle Institute (RTI) and Abt 
Associates Inc. to conduct the Beginning Postsecondary Student (BPS) Longitudinal Study 
and to look at these issues. 

BPS is authorized by law [20 U.S.C. 1221e-l], and [PL 100-297, Sections 300(i) and 
300(k)]. However, the success of the study depends upon your cooperation. Only a 
small sample of students was selected for participation in BPS. Therefore, each student 
represents thousands of similar students who entered college in 1988-89. You have 
provided information to us in the past, and we greatly appreciate this. Now we need to 
ask a few more questions which only you, as a past respondent, can answer. The answers 
to these questions will help to assure that the Federal government is spending its money 
in ways that best help students such as yourself. 

Let me assure you that NCES and its contractors adhere to the highest standards in 
protecting the privacy of individuals involved in the studies it undertakes. Stringent 
measures will be used to safeguard the confidentiality of participants during the 
collection, analysis, and reporting of all survey data. 

We sincerely appreciate your cooperation in the past and we thank you in advance for 
your continued cooperation in helping us conduct this important study. If you have any 
questions about the study, please contact Terry Blake, toll free, at 1-800-452-6655. 



Si: 




Emerson J. Elliott 
Acting Commissioner 
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Beginning Postsecondaiy Students 

A Longitudinal FoUowup of the National Postsecondai? Student Aid Study 

December, 1990 



John 

South Highway 

Alice 

Dear Parent of : 

Research Triangle Institute (RT!) and Abt Associates Inc. (AAI) are preparing for the 
Beginning Posisecondary Siudent (BPS) Longitudinal Study, sponsored by the National Center 
for Education Statistics (NCES) of the U.S. Department of Education. BfSis the first 
foliowup of the National Postsecondary Studc,: Aid Study (NPSAS) in which your son, 

. became a participant in 1989. When he completed the questionnai: , he 
gave us your name and address as the one most likely to know where we could contact him 
for the first follow-up survey. We are seeking your help now. 

Your son has already made a valuable contribution to the NCES Postsecondary Longitudinal 
Studies Program, and we would like to offer him the opportunity to do so agai.: Thousanc* 
of students have taken part in the program and continue to do so. The data arr vaiuable 
resource for educators and policymakers as they address the challenges and debate about the 
quality of education, the effect of that education on the lives of Americans, and the most 
effective way to support student participation in postsecondary education and financial aid. 

To prepare for this BPS survey, we are updating our respondent telephone number and 
address files. A page is enclosed on which is entered our record of the information which he 
gave us. Please take a moment to vei iiy, correct, or update the information. Then please 
return it in the postage paid envelope. 

We have enclosed a leaflet with a brief description of the Postsecondary Longitudinal Studies 
Program in general, and BPSln particular, in which your son is a participant. It also explains 
the legal safeguards that wilMJli taken to protect the confidentiality of the information that the 
students provide. 

If you have questions about the study, please do not hesitate to call Terry Blake at the 
following toll free number, 1-800-452-6655. We thank you for your assistance and the 
opportunity it gives the participant to continue to take part in this important program. 

Sincerely, 



Shirley Knight 
Beginning Postsecondary Student Study 
Deputy Project Director, AAI 




PoitMOondary Ix»ngitudlnjd StudlM Progrmin o** NAtional Center for Edocatlon Staibtlct 

105 



BEGINNING POSTSECONDARY STUDENT LONGITUDINAL SURVEY 

Parent 



BPS 8579 



Student Address Information 



A. This is the address your son or daughter gave us as their address in 1989. If not currefUfy correct, 
please update in the space provided 



Name: 



Address: 



Home phone: ( \ ElfilkLl X- 



F lease check here if all infonnatiou printed above is correct* 



B. 'x\m is what we were given a ? your address, if not currently correct, please update in the space provided 



Namf:: 



Address: 



Viomc paOur.X ) Work: { ) 



□ Please check here if all information printed above Ls correct. 



Thank you for your cooperation and participation. This information is strictly confidentiaL 
Please return this form in the enclosed postage paid envelope. 



Er|c 




Beginning Postsecondary Students 



A Longitudinal FoUowup of the National Post^econdary Student Aid Study 



December, 1990 



Christopher 
Hamilton Street 
Duncanville 

Dear Friend/Relative of : 

Research Triangle Institute (RTI) and Abt Associates Inc. (AAI) are preparing for the 
Beginning Posisecondary Sindent (BPS) Longitudinal Study, sponsored by the National Center 
for Education Statistics (NCES) of the U.S. Department of Education. BPSh t^e first 
follov^up of the National Posisecondary Student Aid Study (NPSAS) in which 

. ' became a participant in 1989. When he completed the questionnaire, he gave us your 
name and address as one of the people most likely to know where we could contact h'-m for 
the first follov^up survey. We are seeking your help now. 

To prepare for this BPS survey, we are updating our respondent telephone numb'^r and 
address files. A page is enclosed on which is entered our record of the information which he 
gave us. Please take a moment to verify, correct, or update the information. Then please 
return it in the postage paid envelope. 

We have enclosed a leaflet with a brief description of the Postsecondary Longitudinal Studies 
Program in general, and BPS\n particular, in which he is a participant. It also explains the 
legal safeguards that will be taken to protect the confidentiality of the information that 
students provide. 

If you have questions about the study, please do not hesitate to call Terry Blake at the 
following toll free number, 1-800-452-6655. We thank you for your assistance and the 
opportunity it gives the participant to continue to take part in this important program. 

Sincerely, 
Shirley Knight 

Beginning Postsecondary Student Study 
Deputy Project Director, AAI 
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BEGINNING POSTSECONDARY STUDENT LONGITUDINAL SURVEY 

Friend or Relative 



BPS S579 

Student Address Informatioii 



A. This is the address the shideni gave us as his or her address in 1989. If not currently correct, please 
update in the space provided. 



Name:. 



Address:. 



Home phone: f ^ V/orV ( 



ED Please check here if all information printed above is correct. 



B. Tnis is what we were given as your address. If not currently correct^ please update in the space provided. 



Name: 



Address:. 



Home phonc:i ) Work: ( \ 



G Please check here if all information printed above is correct* 




Thank you for your cooperation and participation. This iuformatiOQ is strictly coofldentiaL 
Please return this fonu in the enclosed postage paid envelope. 
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Beginning Postsecondary Students 



A Longitudinal FoUowup of the National Postsecondary Student Aid Study 



Research Triangle Institute (RTI) and Abi Associates Inc. (AAI) arc preparing for the Beginning Postsecondary 
Studeni fBPS) Longitudinal Study sponsored by the National Center for Education Statistics (NCES) of the U.S. 
Department of Education. BPS is the first follovcup of the National Postsecondary Student Aid Study (NPSAS) in 
uhich you became a participant in 1989. 

In the 1989 survey you gave us information that would make it possible for us to contact you this year so that you 
can continue to take part in this important studv. The information you provided has been entered on the enclosed 
form. To prepare for this BPS survey, ue are updating our telephone and address files. Please take a moment to 
verify, correct or update the information you ga\e us then and return the form in the postage paid envelope. 

^our participation in NPSAS has made a valuable contribution to the NCES Postsecondary Longitudinal Studies 
Program o! vthich NPSAS and its followup. BPl are components. Thousands of students have taken part in the 
program and continue to do so. The data that they, and you. have provided are a valuable resource for educr'.ors 
and policymakers as they address the challenges and debate about the quality of education, the effect of that 
education on the U\cs of Americans, and the most effective vcay to support participation in postsecond -y ecjcation 
and financial aid. 

In February or March an intervie>fcer from RTI will call to conduct an interview vciih you by telephone. During 
the intervie^^ you will be asked questions about such things as your education, the schooKs) you attended or are 
attending, your employment during your school attendance and after, ho^ you financed your education, and your 
goals and aspirations. 

For your convenience a ^^orksheet has been enclosed for you to use as an aid in organizing your experience since 
February. 1989. beforr the inter^ie^^er calls. Kno^fcing the answers before the call will save you time during the 
intervie^^. 

Vie ^fcant to assure you that under Federal la^^ all information obtained from BPSas well as the earlier National 
Postsecondary Student Aid Study ^fcill be kept strictly confidential and cannot be disclosed or released to your 
school or any other group or individual. 

Public reporting burden for this collection of information is estimated to vary from 40 to 50 minuies per response, 
uith an average of -I5 rriinutes per response, including the lime for reviewing instructions, searching existing data 
sources, gathering and maintaining the data needed, and completing and reviewing the collection of information. 
Send comments regarding this burden estimate or any other aspect of this collection of information, including 
suggestions for reducing this burden to the U.S. Department of Education. Information Management and 
Compliance Division. Washington. D C. 20202-4651: and to the Office of Management and Budget. Paperwork 
Reduction Project 1850-0631. Washington. D C. 20202. 

Enclosed you will find a leaflet with a brief description of the Postsecondary Longitudinal Studies Program as well 
as greater detail about the confidentiality regulations under vihich the data are sought. If you would like more 
information about the survey, please call Terry Blake at the following toll free number. l-'80O-452-6655. We thank 
you for your past participation and look forward to your continuing help in this important study. 
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December, 1990 



Mr. David 



Dear Mr. 




Shirley Knight 
Beginning Postsecondary Student Study 
Deputy Project Director* AAI 
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BEST COPY AVAILULE 



BEGINNING POSTSECONDARY STUDENT LONGITUDINAL SURVEY 

BPS 8579 

Student Address Information 

A This is the address you gave us in 1989. If not cuntntfy correct, please updaU in the space provided. 



Name: 



Address: 



Home phone: ( 'S Work: ( \ 

O Please check here if all mformatioa printed above is correct 
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B. This is what you gave us as your parents^ or guardians^ address. If not currently correct, please update 
in the space provided 



Name: 



Address: 



Home phonc:X=^) Work: ( \ 

O Plea c cLeck here if all information printed above is correct 



C. This is the address you gave us for someone ot her than vour parent, wfto will be able to locate you. 
If not currently correct, please update in the space provided 



Name:, 



Address: 



Home phone: ( ) Work: ( ^ 

□ Please check here if all information printed above is correct* 



Thank you for your cooperation and participation* This hifonnatlon l% strictly e jfldentlaL 
Please return this form in the enclosed postage paid envelope* 
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Beginning Postsecondary Students 



A Longitudinal Followup of the National Postsecpndaw Student Aid Study 



Administrator Name 
School Name 
Address 1 
Address 2 
City State Zip 

Dear (Administrator Narne): 

Scientific Surveys International (SSI), a division of Abt Associates Ina (AAI) requests your 
assistance Li conducting a field test for the natioual Begiming Postsecondary Student (BPS) 
Longitudinal Study sponsored by the National Center for Education Statistics (NCEo) of the 
US. Department of Education, We would like to thank you for your assistance in 1989 in the 
National Postsecondary Student Aid Study (NPSAS) and sef^k your help in locating those 
students who attended your school and participated in that survey. The Begmmng Postsecondary 
Student Longitudinal Study is part of the NCES Postsecondary Longitudinal Studies Program. 
The purpose of BPS is to provide data that will inform education and financial aid policy 
concerning undergraduate access to postsecondary education, student persistence, pjnogre&>, md 
attainment as they mcTve through school, as well as the personal and societal benefits tha: result 
from continuing study. BPS is endorsed by 11 higher education associations (list endosc^?) who 
encourage your assistance in this effort. 

At the time of the 1989 field test you appointed (name) to assbt the study in obtaining 
enrollment, locator, and financial aid data for the students who were selected in the field test 
survey sample. We hope that the coordinator whom you designated then will continue in that 
position for the 1991 BPS field test. 

Approximately 2,000 students from 73 schools became participants in this ongoing study when 
they took part in the field test. We look forward to talking with apprcodmately 14,000 NPSAS 
respondents from about 1,200 schools during the main survey. With your help all of the field 
lest participants will be given an opportunity to continue to be part of this important study. 

Within the next month we will send to the coordinator a request for information regarding the 
current educational status (e.g., still enrolled at your school, graduated from his/her chosen 
program) of the 1989 respondents who attended your school We would also like to obtain the 
most current address and telephone number that may be available in your records for the 
students and their parents. We will submit a list of the students' names with the information 
that your school gave us in 1988 and ask for confirmation of the data, if possible, or correction, 
update, or additioni; to it A format for ease of recording information has been developed for 
the schools use. 

Our request will be for information that will be kept separate from any data files. Nevertheless, 
privacy and confidentiah'ty are always of concern to institutions and offices that maintain studen 
records. NCES and the organizations under contract to it adhere to the highest standards in 
protecting the privacy of individuals involved in the research it undertakes. Appropriate 
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measures arc employed to ensure the confidentiality of research partfdptntf during the 
collection, analysis, and reporting of all survey data. Of course, all relevant safeguards wiU be 
applied to this study. 

TTie collection of information is being sought under the prevision of the Family Education 
Riidits and Privacy Act (FERPA) (20 UZ.C. 1232g) 34 CFR 9931 (a) (3) (ii), (6), and directory 
information is being coUe id under provisions of FERPA (20 U.S.C. 1232g) 34 CFR 9933 (2) 
(c) and 9937 (a) (3)(b) that allows the release of directory information to the Secretary of 
Education or his agent without prior written consent by survey subjects. Both the purpose for 
and the manner in which the information is acquired are in keeping with the FERPA 
requirements. 

The Besinning Postsecoridary Student Lon^tudinal Study is authorized by the General Education 
Provisions Act, as amended [20 US.C 1221e-l], and The Higher Education Amendments of 
1986, as amended by the Hawkins-Stafford /jnendments of 1988 
[PL ioO'297, Sections 300(i) and 300 (k)]. 

Enclosed you will find a leaflet that will give you a brief description of the Postsecondary 
Longitudinal Studies Program in general, and BPS in particular, as well as greater detail about 
the confidentiality regulations under which data are sought 

We hope that we will be able to continue to work with the coordinator who assisted us in the 
1989 field test, and that you will confirm his or her continuation in this role on the enclosed 
postage-paid return postcard. If, however, that is not possible, we would appreciate it if J»"U 
woulu appoint another member of your staff and enter his or her name on the postcard. In 
either case, please return it by December 21 or as soon thereafter as possible so that we may 
direct the package of materials to the appropriate person. 

If you have any questions about the study, please do not hesitate to caU me at (312) 621-3847 
(collect). 

Sincere!)', 



Shirley Knight 

Beginning Postsecondary Student Study 
Deputy Project Director, AAI 
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.Qilr^S Beginning Postsecondary Students 




Coord Name 
School Name 
Address 1 
Address 2 
City, State Zip 

Dear (Coordinator Name): 

Scientific Surveys International (SSI), a division of Abt Associates Inc. (AAI) requests your 
assistance in conducting a field test for the national Begiming Postsecorulary Student C^PS) 
Longitudinal Study sponsored by the National Center for Education Statistics (NCES) of the 
US. Department of Education. We would like to thank you for your assistance in 1989 in the 
National Postsecondary Student Aid Study (NPSAS) and seek your help in locating those 
students who attended your school and participated in that survey. The BegUming Postsecondary 
Student Longitudinal Study is part of the NCES Postsecondary Longitudinal Studies Program. 
The purpose of BPS is to provide data that vnH inform education and financial aid policy 
concerning undergraduate access to postsecondary education, student persistence, progress and 
attainment as they move through school, as well as the personal and societal benefits that result 
from continuing study. 

As your school^ coordinator for the 1989 Celd test you helped the study obtain enrollment, 
locator, and financial aid data for the students who were selected in the Celd test survey sample. 
We hope that you will continue in the role of coordinator for the BPS field test. In future BPS 
srjdies we will seek your help in obtaiaing additional institution information concerning the 
same students. 

Approximately 2,000 students from 73 schools became participants in this ongoing study when 
they took part in the field test. We look forward to talking with approximately 14,000 NPSAS 
respondents from about 1,200 schools during the main survey. With your help all of the Celd 
test participants will be given an opportunity to continue to be part of this important study. 

Within the next month we will send to you a request for information regarding the current 
educational status (e.g., still enrolled at your school, graduated from his/her chosen program) of 
the 1989 respondents who attended your school. We would also like to obtain the most current 
address and telephone number that may be available in your records for the students and their 
parents. We will submit a list of the students' names with the information in our records and 
ask that you confuro the data, if possible, or correct, update, or make additions to it A format 
for ease of recording information has been developed for your use. 

Our request will be for information that will be kept separate from any c'ata files. Nevertheless, 
privacy and confidentiality are always of concern to institutions and offices that maintain student 
records. NCES and the organizations under contract to it adhere to the highest standards in 
protecting the privacy of individuals involved in the research it undert'ikes. Appropriate 
measures are employed to ensure the confidentiality of research participants during the 
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collection, analysis, and reporting of aU survey dau. Of course, ill relevant safeguards will be 
applied to this study. 

Tlic collection of information is being souglit under llie provision of the FaLmfly Education 
Rights and Privacy Act (FERPA) (20 US.C 1232g) 34 CFR 99.11 (a) (3) (iO, (6), and directory 
iniormatioD is being collected under promions of FERPA (20 US.C 1232g) 34 CFR 9933 (2) 
(c) and 99 37 (a) (3)(b) that allows the release of directory information to the Secretary of 
Education or his agent without prior written consent by survey subjects. Both the purpose for 
and the manner in which the information is acquired are in keeping with the FERPA 
requirements. 

Tiie Beginning Postsecondary Student Longitudinal Study is authorized by the General Education 
Provisions Act, as amended (20 US.C. 1221e-l], and The Higher Education Amendments of 
1986, as amended by the Hawkins-Stafford Amendments of 1988 
[PL 100-297, Sections 300(i) and 300 (k)]. 

Enclosed you will find a leaflet that will give you a brief descr^jtion of the Postsecondary 
Longitudinal Studies Program and BPS in particular, as well as greater detail about the 
confidentiality regulations under which data are sought. 

You will also find enclosed a postage ^aid return postcard for your use in confirming your ro^e 
as coordinator for the Beginning Postsecondary Student Longitudinal Study. We would apprectJite 
the return of the postcard by December 21 or as soon thereafter as possfl:Je so that we may 
direct the package of materials to the appropriate person. 

If you have any questions about the study, please do not hesitate to call me at (312) 621-3847 
(collect). 

Sincerely, 



Shirley Knight 

Beginning Postsecondary Student Study 
Deputy Project Director; AAI 
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Beginning Postsecondary Students 

A Longitudinal Followup of the National Postsecondary Student Aid Study 

December 1990 



Dear Coordinator: 

Thank you for your offer of assistance to Scientific Surveys International (SSI) in conducting a 
field test for the national Beginning Postsecondary Student (BPS) Longitudinal Study sponsored 
by the National Center for Education Statistics (NCES) of the US. Department of Education. 
Your help in locating those students who are participants in this ongoing study will make it 
possible for them to continue their participation. The enclosed leaflet describes BPS, the study 
objectives and purpose, and BPS as a component of the NCES Postsecondary Longitudinal 
Studies Program, 

In 1988 your school provided information that made it possible to contact the students from 
your school who became participants in BPS. We are requesting information regarding the 
educational status of the respondents as well as a correction or update of the locator 
information that you gave to the study previously. 

Enclosed you will find the following items: 

• A master list of the students for whom information is requested with a box to check tzr 
those individuals for whom no confirmation, correction, or update is available. 

• An Administrative Information Sheet for each participant (two sides) 

• A Guide to the Administrative Information Sheet that will answer your questions about 
the information requested and completing the document. 

• A leaflet that describes the study; lists the postsecondary organizations that endorse the 
study; clearly states both the legal constraints and the commitment of the organizations 
that collect the data in maint^^ining complete confidentiality for your school and for the 
participants. 

• A postage paid return envelope for the return of the master list of students and the 
Administrative Sheets. 

We would appreciate the return of the documents by January 31 so that all of the participants 
will be given the opportunity to continue as part of this major study. If you have any questions 
about the study or our request, please call me at (312) 621-3847 (collect). 

Thank you for your assistance. 

Sincerely, 
Shirley xiSght 

Beginning Postsecondary Student Study 
Deputy Project Director, AAI 
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Postsecondary Lon^tudmal Studies Program 
Beginning Postsecondary Student Study 
GUroE TO THE ADMJNISTRATTVE INFORMATION SHEET 
(Student Address and Enrollment Sutus Update) 

An Administrative Information Sheet has been sent to you for eadi of the students who were 
members of the National Postsecondary Student Aid Study (NPSAS) attending your school in 
1989-90 as Beginning Postsecondary Students. Below are directions for completing the forms. 
Although the sources of information will vary from school to school* wc have noted some 
suggestions for locations where the information might be found. 

If your school maintains computerized records, it is possible that all of the information can be 
accessed from the Office of the Registrar. Since methods of maintaining student records vary, 
listed below are probable sources that may be able to assist you in obtaining the information. 

• Office of the Registrar 

• The Student Directory 

• Financial Aid Office 

• Office of the Student Counselor 

• Student Employment Office 

• Alumni Office 
ADDRESS INFORMATION UPDATE 

Page one of the address form contains four sections* In each section is entered information 
taken directly from our files, if available. Your school provided this information in 1988. If 
your records currently... 

• indicate more recent information, e.g., the student has married and changed her 
name, the parents have moved to another city, please complete the section by entering 
that information in the space to the right. 

• duplicate the preentered data, please confirm that fact by checking the bcoL 

• contain information for the student, parent, or emergency contact (even though the 
data do not appear in our files), please enter the information in the appropriate 
section. 

• do not have any information for one or more sections, please write "no information" 
in that section. 

STUDENT ENROLLMENT STATUS 

The opportunity for the student to continue his or her participation is assured if he or she is 
currently enrolled at your school. A check in the first box on page two will tell us that. 
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Knowing that the student... 

• transferred to another school and, if possible, to which school 

• has completed the program he or she was taking and has, perhaps, entered the 
workforce 

• has left your school without completing the program 

will help us determine other sources that may assist in locating the participant, if necessary. 
STUDENT EMPLOYMENT 

If the student employment office has a record of placing the student, please check the box and 
enter the employment data. 

COMMENTS 

Space has been provided for you to enter any comments that you think will assist us in locating 
the student so that we may offer him or her the opportunity to continue participating in BPS. 

RETURNING THE INFORMATION 

A postage paid envelope has been enclosed for your convenience in returning the information 
forms. We will appreciate it if you will complete them by January 31, 1991. 
Thank you for your assistance. 

PubUc reporting burden for this coUection of informaiion is estimated to average 5 
minutes per rt^nse, including the time for reviewing instructions, searching 
existing data sources, gathering and maintaining the data needed, and completing 
and rtviewin.** the coUeaion of information. Send comments regarding this burden 
estimate or y other aspea of this collection of information, including suggestions 
for reducing this burden, to the U. S. Department of Education, Information 
management and Compliance Division, Washington, D.C. 20202-4651; and to the 
OfTlce of Management and Budget, Paperwork Reduaion Project I&50^3, 
Washington, D.C. 20503. 



2 

121 



BEGINNING POSTSECONDARY STUDENT LONGITUDINAL SURVEY 
Administrative Information Sheet 

BPS 8579 

Stmdent Add ress Information 

A. This is (hf gtudgnt'i local addrgsi pfovided by your institutional MOfds. If mot cutrtntfy coma, pUau itpdttit in the Mpace provided. 

Namc! 



Address:. 



Home phone : ( ) Work ( ^ 

D Please check here if all information printed above is correct 

B. This b the ttudent^s permanent address prvvided by your insdtutional rtcofds. If not cuntntfy eontct, please update in the space 

provided. 

Name: 



Address: 



Home phoDe:J^_) Work ( ^ 

O Please check here if all information printed above is correct. 

C This is the student's parents* or £ugrdians* address provided by your institutional records. If not currently correct » please update in the 

space provided. 

Name: 



Address: 



Home phone: ( \ Work ( \ 

□ Please check here if all information printed above is correct. 

D. This is the emergency contact or other parent'i address provided by your institutional records, if not cuntntly comet, please update in 
the space provided. 



Name:, 



Address: 



Home phone: ( ) Work ( ) 

□ Please check here if all inrormation printed above is cflrrcd. 

••• IMPORTANT: PLEASE COMPLETE THE REVERSE SIDE OF THIS FORM,*** 
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BEGINNING POSTSECONDARY STUDENT LONGITUDINAL SURVEY 

Fonn Appr 
OMB. No. 1850 
Exp. 12 

Strident Enro llment Status 

In the section below check the student^s amSBl enrollment status at your school 
O as currently enrolled at this school 

D completed a school program and received a degree, d4)loma, certificate or license. 

Date completed school program: . 

n is nol enrolled at this time and has not con^leted a sdiool program. 

Date of last enrollment: 

// not currently enrolled at your school^ 

n the student is known to have transferred to another school 

Date of school transfer: 

If the student is a transfer and you know the name of the school to which he or she transferred, 
please write in the name and location of the new school 

Name of new school_ 

City and state of new school 

□ Check here if the student is nal currently enrolled (a program completer, dropout or possible transfer) 
and requested that a transcript be sent to one or more different schools. 

D Check here if the student was placed in a job by your school after completing a program and provide 
employer name and address. 

Employer 

City and State 

Phone 

Comments: 



Thank you for your cooperation and parllclpatlon. This Information (s strictly conndcntlat 
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Appendix B 

Copy of Facsimile Questionnaire - Main Interview 
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A. Introduction and Validation B-1 

B. Education Experiences B-10 

C. Education Financing B-20 

D. Work Experiences B-24 

E. Other Education or Training B-30 

F. Demographic Information B-32 

G. Family Information B-34 

H. Goals. Aspirations. Expectations B-39 

I. Public Service and Voting Experience B-46 

J. Locator information B-48 
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Introduction and Validation 



1. May I speak with (respondent's name)? 

a. (STUDENT IS AVAILABLE.) (CONTINUE WITH INTERVIEW.) 

b. (STUDENT NOT AVAILABLE.) (MAKE APPOINTMENT.) 

c. (STUDENT NO LONGER AT THIS PHONE NUMBER.) (TRY TO GET NEW 
NUMBER.) 

d. (TELEPHONE NUMBER HAS BEEN CHANGED.) (TRY TO GET NEW 
NUMBER.) 

e. (TELEPHONE HAS BEEN DISCONNECTED.) (DISCONTINUE.) 

f. (NO SUCH STUDENT KNOWN TO HOUSEHOLD.) (DISCONTINUE.) 

2A. (TIME STAMP ON THIS SCREEN) Hello, my name is (interviewer's name) and I am 
calling on behalf of the United States Department of Education. I am with the Research 
Triangle Institute. Recently we sent you a letter explaining the Beginning Postsecondary 
Student Study that we currendy are conducting. 

a. Did you receive the letter? 

(1) (YES.) (IF WORKSHEET CODE > 1, GO TO 2A.b. OTHERWISE GO 
TO A.5.) 

(2) (NO.) (IF WORKSHEET CODE > 1, SET 2A.b to"NO" AND GO TO 
A. 3; OTHERWISE GO TO A. 3) 

b. Did you receive the Worksheet that we included with the letter? 

(1) (YES.) (G0T0 2A.C.) 

(2) (NO.) (G0T0 2A.e.) 

c. Did you use the worksheet? 

(1) (YES.) 

(2) (NO.) 

d. Do you have the Worksheet handy where you can get to it easily? 

(1) (YES.) Will you please get the Worksheet. (GO TO A.5.) 

(2) (NO.) (G0T0 2A.e.) 

e. The worksheet we sent was to help you organize your [education (IF WORKSHEET 
CODE == 3)/work (IF WORKSHEET CODE = 2)] experiences since we last talked 
with you in 1989. If you have [been in school for more than a year (IF 
WORKSHEET CODE = 3)/held a number of jobs (IF WORKSHEET CODE = 2)] 
since February of 1989, we think your having the worksheet available will make the 
interview go a little faster and smoother. Would you like to reschedule the interview 
until [you can get the worksheet (IF 2A.d = "NO")]/we can mail you another 
worksheet (IF 2A.d ^ "NO")] 

(1) WILL LOCATB FOR LATER CALL BACK. (GO TO RESCHEDULE) 

(2) MAIL NEW COPY. (GO TO A.4) 

(3) WILL CONTINUE WITHOUT WORKSHEET. (GO TO A. 5) 



2B. (ALTERNATE, FOR "RESTART" CASE-TIME STAMP ON THIS SCREEN.) 

a. Hello, my name is (interviewer's name). I'm calling back from the Research Triangle 

Institute about the Beginning Postsecondary Student Study. We talked with you 
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recently about this study to find out about your education and work experiences. We 
would like to complete the interview. 

(1) (AVAILABLE.) (IF NOT IN WORKSHEET GROUP GO TO RESTART 
POINT; OTHERWISE GO TO 2B.b.) 

(2) (NOT AVAILABLE.) (RESCHEDULE.) 

b. (IF NOT YET COMPLETED SECTION B AND C AND WORKSHEET CODE =• 
3, OR IF NOT YET COMPLETED SECTION D AND WORKSHEET CODE - 2, 
ASK THE FOLLOWING; OTHERWISE, GO TO RESTART POINT.) Do you have 
the Worksheet we sent you handy? 

(1) Will you please get it so we can continue with the interview? (THEN GO 
TO RESTART POINT.) 

(2) (WILL CONTINUE WITHOUT.) (GO TO RESTART POINT.) 

(3) (WILL NOT CONTINUE WITHOUT.) (RESCHEDULE AND 
DISCONTINUE.) 

3. IF DID NOT RECEIVE LETTER (A.2A.a = "NO") GIVE RECAP OF LETTER, AS 
FOLLOWS: In 1989 you participated in the National Postsecondary Student Aid Study 
(NPSAS). At that time we told you that we would be contacting you later to find out how you 
had been doing. NPSAS and this follow-up study are both mandated by recent legislation. 
The study has been approved by the U.S. Office of Management and Budget (0MB Number 
1850-0631, expiring in November 1991). 

We want to assure you that, under Federal Law, all personally identifiable information 
obtained from this study and from NPSAS will be kept strictly confidential. The information 
you provide will be used for statistical purposes only. If you have any questions about the 
survey, you can call our Project Staff. Graham Burkheimer, Dale DeWitt, or Kathy Rourke 
toll free at 1-800-334-8571. 

Your continued participation in this important study will be extremely helpful to your 
govemmer* and to future students who wish to enter postsecondary education. The 
information that you and others provide will be used statistically to examme how student 
participation in higher education can be better supported and encouraged. 

Because you provided information before, this interview will be based, in part, on your earlier 
responses. We estimate it will take from 40 to 60 minutes. During the interview, we will be 
asking about your education and work experiences since we last talked with you, and about 
your goals, aspirations, expectations, and other related information. 

Your participation in the study has been and continues to be voluntary and neither your 
participation nor any answers you provide will affect any financial aid or other benefits you 
are receiv.ng or expect to receive. We have tried to avoid asking questions that may be 
sensitive or unnecessary, but you may decline to answer any question and may stop at any 
time. If you wish, we can reschedule all or part of the interview at a later time, 

(IF WORKSHEET CODE = 1. GO TO 3.b; IF WORKSHEET CODE > 1, CONTINUE) In 
our letter to you, we also included a worksheet to help you organize experiences in your 
[education (IF WORKSHEET CODE = 3)/employment (IF WORKSHEET CODE = 2)] since 
we last talked with you. If you have [been in school for over a year (IF WORKSHEET 
CODE = 3)/held a number of jobs (IF WORKSHEET CODE = 2)] since February 1989, we 
think your having the Worksheet available will make the interview go a little faster and more 
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smoothly. THEN CONTINUE WITH A. 3. a 

a. Would you like to reschedule the interview until we can mail you a new letter and 
worksheet? 

1 = RESCHEDULE (GO TO A4) 

2 - WILL CONTINUE WITHOUT LETTER AND WORKSHEET. (GO TO A6) 

b. Would you like to reschedule the interview until we can mail you a new letter? 1 = 
RESCHEDULE (GO TO A4) 

2 = WILL CONTINUE WITH LETTER. (GO TO A6) 

4. To what address should we mail the [letter [IF WORKSHEET CODE = l)/letter and 
worksheet (IF WORKSHEET CODE > I AND 2A.a = "NO")AVORKSHEET 
(OTHERWISE)] (WRITE TO DIRECTORY SECTION OF TEMPORARY CATI RECORD. 
DO NOT PLACE IN CATI FILE AND DO NOT OVERWRITE!) 



address 



city state zip 

Thank you very much for your time. We will call you back in a few weeks after you have had time to 
receive our letter [AND/OR a new worksheet]. (RESCHEDULE AND DISCONTINUE.) 

5. (GIVE VERY BRIEF PURPOSE OF STUDY, AS FOLLOWS:) As we told you in the letter, 
this study is a continuation of the National Postsecondary Student Aid Study (NPSAS). You 
participated in that study in 1989. NPSAS and this study are both mandated by recent 
legislation, and have been approved by the U.S. Office of Management and Budget (OMB 
Number 1850-0631, expiring in November 1991). 

We want to reassure you that, under Federal law, all personally identifiable information 
obtained from this study and NPSAS will be kept strictly confidential. The information you 
provide will be used for statistical purposes only. If you have any questions about the survey, 
you can call our Project Staff Graham Burkheimer, Dale DeWitt, or Kathy Rourke toll free at 
1-800-334-8571. 

Your continued participation in the important study will be extremely helpful to your 
government and to future students who wish to enter postsecondary education. The 
information that you anc. others provide will be used to examine how student participation in 
higher education can be better supported and encouraged. 

Because you provided information before, this interview will be based on your earlier 
responses. We estimate it will take about 40 to 60 minutes. Your participation in the study 
has been and continues to be voluntary and neither your participation nor any answers you 
provide will affect any financial aid or other benefits you are receiving or expect to receive. 
We have tried to avoid asking questions that might be sensitive or unnecessary, but you can 
decline to answer any question and may stop at any time. If you wish, we can reschedule all 
or part of the interview at a later time. 
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(TIME STAMP ON THIS SCREEN) Before we begin, I would like to make sure our records 
are correct. According to our records, you were enrolled in (name of NPSAS school/college) 
at some time between July 1, 1988 and June 30, 1989. Is that correct? 

1 = YES. (GOTO A. 11.) 

2 = NO. (GO TO A.7.) 

a. Let me make sure we have the right person. Our records show your full name to be 
(respondent's full name); that is, (SPELL NAME). Is that correct? 

(1) (CORRECT.) (G0T0A.8.) 

(2) (INCORRECT.) (GO TO 7.b.) 

b. Have you ever been known by that name? 

(1) (YES.) 

(2) (NO.) 

c. What is your full name? (WRITE TO DIRECTORY SECTION OF TEMPORARY 
CATI RECORD. DO NOT PLACE IN CATI FILE AND DO NOT OVERWRITE!) 



first name MI last name 

a. (IF BIRTH DATE INCLUDED IN NPSAS FILE, CONTINUE WITH 8, a, 
OTHERWISE GO TO 8.b.) Our records show your date of birth to be: 
. Is that correct? 

mo. day yr. 

(1) (CORRECT,) (GO TO A.9.) 

(2) (INCORRECT.) (GO TO 8.b.) 

b. What is your date of birth? (WRITE TO DIRECTORY SECTION OF 
TEMPORARY CATI RECORD. DO NOT PLACE IN CATI FILE AND DO NOT 
OVERWRITE!) 



mo. day yr, 

a. (IF GENDER DATA INCLUDED IN NPSAS FILE, CONTINUE WITH 9.a, 
OTHERWISE GO TO 9.b.) (UNLESS GENDER IS OBVIOUS) Our records show 
you are [MALE/FEMALE]. Is that correct? 

1 = YES 

2 = NO 

b. (IF NO TO 9.a OR IF GENDER DATA NOT INCLUDED IN NPSAS FILE AND 
GENDER NOT OBVIOUS) (WRITE TO DIRECTORY SECTION OF 
TEMPORARY CATI RECORD. DO NOT PLACE IN CATI FILE AND DO NOT 
OVERWRITE!) 

Are you: 

(1) Male? 

(2) Female? 
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10. (IF INFORMATION FROM A.7 THROUGH A.9 INDICATES THAT THIS IS NOT THE 

RIGHT PERSON; E.G., IF "INCORRECT" TO 7.a AND "NO" TO 7.b, "INCORRECT" TO 
8.a, OR "NO" TO 9. a) There seems to be a problem with the information I have. After 
checking with my supervisor, I may need to call you back. Thank you for your time. 
(DISCONTINUE INTERVIEW.) 

(IF INFORMATION FROM A.7 THROUGH A.9 INDICATES THAT THIS IS THE RIGHT 
PERSON) You seem to be the right person. Do you know of any reason why our 
information shows you enrolled in (name of NPSAS school/college)? (INDICATED 

REASON, IF ANY) . . There seems to be a problem with the 

information I have. After checking with my supervisor, I may need to call you back. Thank 
you for your time. (DISCONTINUE INTERVIEW) 



1 1 . (TIME STAMP ON THIS SCREEN) 

a. When you first started the 1988-89 school year, were you classified as a [(IF NPSAS 
SCHOOL/COLLEGE WAS A FOUR-YEAR COLLEGE OR 

UNIVERSITY)/freshnian (IF NPSAS SCHOOL/COLLEGE WAS OTHER THAN A 
FOUR- YEAR COLLEGE OR UNIVERSITY) first year student]? 

(1) (YES.) (GO TO A. 12.) 

(2) (NO.) (GOTO ll.b.) 

b. What was your classification? (READ CHOICES AS NECESSARY.) 

(1) FRESHMAN (FIRST YEAR STUDENT). 

(2) SOPHOMORE (SECOND YEAR STUDENT). 

(3) JUNIOR (THIRD YEAR STUDENT). 

(4) SENIOR. 

(5) SPECIAL STUDENT (NONMATRICULATED). 

(6) GRADUATE STUDENT 

(7) OTHER. (SPECIFY.) 

12. While you were enrolled in (name of NPSAS school /col lege) in 1988-89, were you: 
(1) YES, (2) NO. 

a. Taking at least one course for credit? (IF *'YES," GO TO A. 14.) 

b. In a program for a degree or formal award? (IF "YES," GO TO A. 14.) 

c. In a program for a specific occupation? (IF "YES," GO TO A. 14.) 

13. If you were not enrolled for any of these purposes, what was your purpose for being in 
school? 

14. a. Prior to July 1, 1988, were you enrolled for credit (excluding continuing education 

credits and credits earned while still in high school) or working toward a certificate, 
diploma, degree, or other award in (name of NPSAS school/college)? 

(1) YES. (GO TO 14. b.) 

(2) NO. (GOTO A. 15.) 

b. When did you last attend (NPSAS school /col lege) before July 1, 1988. 
month year 
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15. Prior to July 1, 1988, but after you completed or left high school, did you ever attend any 
other postsecondary school/college for credit (not counting continuing education credits or high 
school-level credits) or to work toward a certificate, diploma, degree, or other formal award? 

1 - YES (GO TO A. 16.) 

2 == NO (GOTO A. 19.) 

16. When you were enrolled in (name of NPSAS school/college) in 1988-89, had you transferred 
any credits to that school from any of these other postsecondary schooI(s)/college(s)/ 

1 = YES 

2 = NO 

17. What types of schools/colleges were you enrolled in for credit (other than correspondence 
courses) or working toward a certificate, diploma, degree, license, or other formal award prior 
to July 1, 1988? (1) (YES), (2) (NO). 

(a) Occupational, vocational, or technical school? 

(b) Two-year community or junior college? 

(c) Four-year college or university? 

(d) Employer or union provided training? 

(e) Graduate or professional school? 

(f) Other (Specify)__ ^ 

A17a_YR. [IF A 17a YES] In what year did you last attend an occupational, vocational, or 
technical school? 19 ? 

Ai7b_YR. [IF A17b = YES] In what year did you last attend a two-year community or 
junior college? 19 ? 

A17c_YR. [IF A17c = YES] In what ye-ar did you last attend a four-year college or 
university? 19 ? 

A17d_YR. [if A17d = YE3] In what year did you last attend employer or union provided 
training? 19 _ _? 

A17e_YR. [IF A17e = YES] In what year did you last attend graduate or professional 
school? 19 _ _? 

A17f_YR. [IF A17f - YES] In what year did you last attend [SPECIFIED TYPE OF 
SCHOOL]? 19 

18. a. [IF ANSWER TO 17. c or 17. e IS YES] Did you receive a bachelor's degree or 

advanced degree (Master's, Ph.D., Law, Medical) at any school /college prior to July 
1, 1988? 

(1) YES. (GOTO A.lS.a^YR) 

(2) NO. (GO TO A 18b) 

a_YR. In what year did you receive this degree? 19 
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b, [IF ANSWER TO 17.a, 17,b, 17.c, or 17,e IS YES] Did you receive an associate's 
degree at any school/college prior to July 1, 1988? 

(1) YES. (GOTO A,18.b^YR) 

(2) NO, (GOTOAlSc) 

b_YR, In what year did you receive this degree? 19 

c, [IF ANSWER TO 17. b IS YES] were you in an Academic or Occupational program 
at the community colleges you attended? 

(1) Academic 

(2) Occupational 

(3) Both 

d, [(IF ANSWER TO 17,a, 17,d, OR 17,f IS YES OR IF ANSWER TO 17.b IS Yi£S 
AND ANSWER TO 18,c IS 2 OR 3] Did you ever receive a certificate, diploma, 
degree, license, or other formal award from any of the schools you attended? 

(1) YES 

(2) NO 

19, (TIME STAMP ON THIS SCREEN) The next few questions are to make sure we collected 
correct information about yo . in 1989 on some very basic items. (FOR THE FOLLOWING 
ITEMS A. 19 THROUGH A.2;, FILL IN THE VARIABLES FROM PERTINENT NFS AS 
DATA [IF AVAILABLE] VERIFY EXISTING DATA, AND COLLECT ANY MISSING 
DATA.) 



a. (IF NPSAS DATA FILLED IN FOR HIGH SCHOOL COMPLETION STATUS 
ASK 19,a, OTHERWISE GO TO 19,b) Our records show your high school diploma 
status to be (READ APPROPRIATE OPTION), Is this correct? 

(1) (YES,) (GOTO 19.C.) 

(2) (NO,) (GOTO 19.b.) 

b. (IF "NO" TO 19.a OR NPSAS RECORD DOES NOT INCLUDE HIGH SCHOOL 
COMPLETION DATA) What type of high school diploma did you receive? (READ 
CHOICES AS NECESSARY.) 

(1) REGULAR DIPLOMA FROM A PUBLIC OR PRIVATE HIGH SCHOOL 

(2) DIPLOMA OR CERTIFICATE THROUGH GED OR EQUIV.ALENCY 
TEST. 

(3) CERTIFICATE OF HIGH SCHOOL COMPLETION. 

(4) DID NOT COMPLETE HIGH SCHOOL OR HIGH SCHOOL 
EQUIVALENT. 

c. [IF NPSAS DATA FILLED IN, ASK 19.c, OTHERWISE GO TO 19.d] Our records 
show that you received your high school diploma or certificate in 19 , Is that 




(GO TO A.20) 
NO. 



d. 



In what year did you receive your high school diploma or certificate? 



year 
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(IF BIRTH DATE FILLED IN, CONTINUE WITH 20.a, OTHERWISE GO TO 
20.b.) Our records show date of birth to be (READ APPROPRIATE OPTION). Is 
that correct? 

(1) (CORRECT.) (G0T0A.21.) 

(2) (INCORRECT.) (GOTO20.b.) 

(IF "INCORRECT" TO 20.a OR BIRTH DATE NOT FILLED IN) What is your 

date of birth? 

MONTH: 

(1) JANUARY (2) FEBRUARY (3) MARCH (4) APRIL 
(5) MAY (6) JUNE (7) JULY (8) AUGUST 
(9) SEPTEMBER (10) OCTOBER (11) NO"- UMBER 
(12) DECEMBER 

DAY 

YEAR 19 

(IF GENDER FILLED IN, CONTINUE WITH 21. a, OTHERWISE GO TO 21. b.) 
(UNLESS GENDER OBVIOUS) Our records show you are (READ APPROPRIATE 
OPTION). Is that correct? 

(1) YES (GOTOA.22) 

(2) NO 

(IF GENDER NOT OBVIOUS ASK QUESTION; IF OBVIOUS INTERVIEWER 
FILL IN) Are you: 

(1) Male? 

(2) Female? 

(IF RACE DATA FILLED IN, CONTINUE WITH 22.a; OTHERWISE, GO TO 
22.b.) Our records show you to be (READ APPROPRIATE OPTION). Is that 
correct? 

(1) (CORRECT.) (GOTOA.22.C) 

(2) (INCORRECT.) (GO TO 22.b.) 

(11 "INCORRECT" TO 22.a OR RACE DATA NOT FILLED IN) Are you? 
(READ CHOICES.) 

(1) WHITE. 

(2) BLACK. 

(3) AMERICAN INDIAN OR ALASKA NATIVE (ESKIMO, ALEUT). 

(4) ASIAN OR PACIFIC ISLANDER. 

(5) OTHER (SPEC! FY . ) . 

[IF RESPONSE NOT 5, PROGRAM FILLS IN SPECIFY WITH "NA"] 

[IF RESPONSE TO 22.b 3, THEN GO TO 22.e. ELSE, IF NPSAS DATA 
FILLED IN ASK A.22.C, OTHERWISE GO TO A.22.d]. Our records show the 
name of your tribe to be [TRIBE NAME]. Is that correct? 

(1) YES. (GOT0 22.e) 

(2) NO. 

(IF RESPONSE rO 22.b is 3, FILL IN AS "NA") What is the name of your 
tribe? 
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[IF RESPONSE TO 22.b ?s 4, THEN GO TO A.23. ELSE, IF NPSAS DATA 
FILLED IN, ASK A22.e, OTHERWISE GO TO 22. fj Our records show that you 
are [FILL IN ASIAN GROUP]. Is that correct? 

(1) YES. (GO TO A.23) 

(2) NO. 

(IF RESPONSE TO 22.b ?5 4 FILL IN QUESTION AND SPECIFY WITH "NA") 
Are you? 

(1) CHINESE (2) FILIPINO (3) HAWAIIAN (4) JAPANESE 
(5) KOREAN (6) VIETNAMESE (7) ASIAN INDIAN 

(8) SAMOAN (9) GUAMIAN (10) OTHER ASIAN OR PACIFIC ISLANDER 

(SPECIFY) 

[IF NOT 10, PROGRAMS FILLS IN SPECIFY AS "NA"] 

(IF HISPANIC INDICATOR DATA FILLED IN, CONTINUE WITH 23.a; 
OTHERWISE, GO TO 23,b.) Our records show you [are (IF HISPANIC 
INDICATOR - I)/are not (IF HISPANIC INDICATOR - 2)] of Spanich/Hispanic 
origin or descent. Is that correct? 

(1) (CORRECT.) (IF INDICATOR = 1 THEN GO TO 23. c. IF INDICATOR 
= 2 THEN GO TO A.24) 

(2) (INCORRECT.) (GO TO 23.b.) 

Are you of Spanish/Hispanic origin or descent? 

(1) YES. 

(2) NO. [FILL IN 23.C AND 23.d WITH "NA"; GO TO A.24] 

[IF NPSAS DATA FILLED IN ASK 23.c, OTHERWISE SKIP TO 23.d]. Our 
records show that you are [FILL IN HISPANIC TYPE]. Is that correct? 

1 = YES. (GO TO A.24) 

2 = NO. 

Are you? 

(1) MEXICAN, MEXICAN AMERICAN, CHICANO 

(2) CUBAN 

(3) PUERTO RICAN 

(4) OF SOME OTHER SPANISH/HISPANIC DESCENT (SPECIFY) 



[IF NOT 4, PROGRAM FILLS IN SPECIFY AS "NA"] 

(IF CITIZENSHIP DATA FILLED IN, CONTINUE WITH 24.a, OTHERWISE GO 
TO 24. c) Our records show that you [ are (IF CITIZENSHIP = l)/are not (IF 
CITIZENSHIP = 2)] a citizen of the U.S. Is that correct? 

(1) (YES.) (GO TO SECTION B) 

(2) (NO.) (GOT0 24.b) 

(IF CITIZENSHIP DATA NOT FILLED IN OR "NO" RESPONSE TO 24.a) Are 
you a citizen of the United States? 

(1) (YES.) 

(2) (NO.) 
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(IF RESPONSE TO 24.a IS "NO" AND RESPONSE TO 24.B IS "YES") When did 

you receive your U.S. Citizenship? 

MONTH: 

(1) JANUARY (2) FEBRUARY (3) MARCH (4) APRIL 
(5) MAY (6) JUNE (7) JULY (8) AUGUST 
(9) SEPTEMBER (10) OCTOBER (11) NOVEMBER 
(12) DECEMBER 
YEAR: 19 



B. F.Hnr.ation Hxneriences (TIME STAMP ON THIS SCREEN) 

The next set of questions is about your Educational Experiences since we last spoke with you. We 
would like to know the names of all postsecondary schools you have been enrolled m for credit (or to 
obtain a certificate, license, diploma, or other formal award) (NOT COUNTING 
CORRESSPONDENCE COURSES). We would also like to collect information about the terms dunng 
which you were enrolled. "TERMS" means different things at different postsecondary schools and 
colleges depending on the calendar system used by the school. Some schools are on a quarter system 
or semester, trimester, 4-4-1, or some other calendar system, to define terms. Schools may also have 
one or more summer sessions, which are additional terms. Other schools have specific fixed-length 
courses of instruction that may start at different times during the year and that may or may not be 
broken up into smaller units. In this case, the entire course of instruction may be a single term. We 
are interested in all terms you were enrolled m all school.s, even if you did not complete tl e term. [IF 
WORKSHEET GROUP = 3 AND (A.2A.d= 1 OR A.2B.b= 1) CONTINUE WITH INTRODUCTION; 
OTHERWISE GO TO B. 1]. The worksheet we sent you provides rows for each school and term and 
the column headings show some of the information we would like to collect. If you con.sult your 
worksheet, it will probably help you organize your thoughts better in answering these questions. 



First, we would like to ask you about the terms during which you went to (NPSAS SCHOOL). 



[PROGRAM DISPLAYS A SCREEN WITH THE FOLLOWING FORMAT: 

Start Month Start Year End Month End Year 

1 19 19 

2. ZZZ 19 19 

3 19 19 

4. 19 19__ 

5. 19 19 

6. 19 19__ 

7. 19 19 

8. 19 19 

9. 19 19 

10. 19__ 19 

11. " 19 : 19 — 
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[ALL NPSAS SCHOOL TERM INFORMATION (TERMS INCLUDING JULY 1988 OR 
LATER) IS GATHERED ON THIS ONE SCREEN. PRELOADED DATA WILL BE 
FILLED IN WHICH THE INTERVIEWER CAN VERIFY WITH THE RESPONDENT. 
EXISTING TERMS CAN BE CHANGED OR DELETED AND THEN NEW TERMS CAN 
BE ADDED (MAXIMUM OF 11 TERMS). AS EACH TERM IS ADDED, DELETED, OR 
MODIFIED, THE ENTIRE LIST IS SORTED BY THE START DATES. ALSO, ONCE 
THIS SCREEN HAS BEEN DISPLAYED, A FLAG IS SET SO THE PROGRAM WILL 
NOT BE RUN AGAIN.] 

2. (TIME STAMP ON THIS SCREEN) Now I want to ask you about any other schools and the 
terms in which you may have gone to these schools. 



Start Start End End 

School Name Month Year Month Year 

1 19 19_ 

2 19 19_ 

3 19 19_ 

4 19 19_ 

5 19 19_ 

6 19 19_ 

7 19 19_ 

8 19 19__ 

9 19_ 19_ 

10 19 " 19 



[ALL ADDITIONAL SCHOOL TERM INFORMATION IS GATHERED ON THIS ONE 
SCREEN. PRELOADED DATA (TERMS INCLUDING JULY 1988 OR LATER) WILL BE 
FILLED IN, WHICH THE INTERVIEWER CAN VERIFY WITH THE RESPONDENT. 
EXISTING TERMS CAN BE CHANGED OR DELETED AND THEN NEW TERMS CAN 
BE ADDED (MAXIMUM OF 10 TERMS AND UP TO FOUR DIFFERENT SCHOOLS). 
AS EACH TERM IS ADDED, CHANGED, OR DELETED, THE ENTIRE LIST IS 
SORTED BY THE START DATES. ALSO, ONCE THIS SCREEN HAS BEEN 
DISPLAYED, A FLAG IS SET SO THE PROGRAM WILL NOT BE RUN AGAIN.] 

[B.3 IS REPEATED FOR ANY SCHOOL/COLLEGES IDENTIFIED IN B.2 THAT WERE NOT 
PRELOADED.] 

3. What was the name, city and state of (the first, second, etc. [DEPENDING ON RESPONSE 
TO B.3] of these) school(s) or college(s)? 

a. Institute name: 

Address: City (Post Office): ~ SUite: 



NOTE TO INTERVIEWERS: CHECK WITH RESPONDENT IF NEEDED TO BE SURE 
OF SPELLING OF CITY OR POST OFFICE. USE NO PUNCTUATION MARKS IN CITY 
NAME AND DO NOT ABBREVIATE : SEE SPECIAL INSTRUCTIONS. ALSO, PROBE 
RESPONDENT FOR CORRECT SCHOOL NAME; SOME WILL GIV3 A SCHOOL 
WITHIN A UNIVERSITY RATHER THAN THE UNIVERSITY (E.G., FUQUA SCHOOL 
OF BUSINESS RATHER THAN DUKE UNIVERSITY).] 

[USER EXIT AND SCREENS FOR VERIFICATION OF IPEDS CODE GO HEREl 
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(1) IPEDS CODE FILL IN . (IF LAST 

ADDITIONAL SCHOOL, GO TO B.5; OTHERWISE REPEAT B.3.a.l 



(2) NO IPEDS MATCH (GO TO B.3.c) 

c. Was (school name) 

(1) A university or 4-year college? 

(2) A 2 or 3 year junior college or community college? 

(3) A vocational or occupational school? 

(4) Some other type of school? 

d. Was (school name) 

(1) Public 

(2) Private (nonprofit; 

(3) Private (for profit) 

[IF LAST REPEAT OVER ADDITIONAL SCHOOLS, GO TO B.6; OTHERWISE REPEAT B.3.a.] 

[IF ATTENDED ONLY NPSAS SCHOOL (I.E., NO PRELOAD OR NEW ENTRIES IN B.2). GO 
TO B 7; OTHERWISE, CONTINUE WITH B.O. B.6 IS REPEATED N TIMES (WHERE N IS THE 
NUMBER OF OTHER SCHOOLS ATTENDED (FROM NUMBER OF PRELOAD SCHOOLS + 
NUMBER OF NEW ENTRIES IN B.2); LIMITING TO 4 REPEATS). START WITH LAST 
SCHOOL LISTED IN B.2 (OR PRELOAD) AND WORK BACK TO FIRST SCHOOL LISTED IN 
B 2 OR PRELOAD, (IF APPLICABLE). INSTRUCTIONS FOR BRANCHING AND FILL-INS 
ASSUME A COUNTER, K, THAT IS SET AT NUMBER OF PRELOAD "OTHER SCHOOLS" + 
NUMBER OF NEW ENTRIES + 1 PRIOR TO REACHING SCREEN FOR 6. a, AND WHICH IS 
THEN DECREMENTED BY 1 EACH TIME SCREEN 6.a IS REACHED.] 

6. a. (TIME STAMP ON EACH REPEAT OF B.6.a, IF ASKED.) When you were 
enrolled in (name of school/college K in B.4 or B.2), did you transfer (or plan to 
transfer) credits, courses, or clock hours from (fill in name of NPSAS school) [and 
(fill in name of schools 1 through K-1 from B.4 and B.2) (IF K > 1)]? 

(1) YES, TRANSFERRED CREDITS FROM ONE/OR MORE OF THE 
SCHOOLS. (GO TO 6. b.) 

(2) YES, PLANNED (OR PLAN ) TO TRANSFER CREDITS FROM ONE OR 
MORE OF THE SCHOOLS (GO TO 6.b) 

(3) NO. (GO TO 6. d.) 

b [IF K - 1, FILL IN ALTERNATIVE 1 OF B.6.b AS "YES" AND ALL OTHER 

ALTERNATIVES AS "NA"; THEN GO TO B.6.C, IF RESPONSE TO B.6.a WAS 
1 OR TO B.7, IF RESPONSE TO B.6. a WAS 2. IF K > 1, ASK QUESTION. IF 
4'> K > I, FILL IN ALTERNATIVES K + 1 THROUGH 5 WITH "NA" AND 
DO NOT FILL IN THOSE SCHOOLS ON THE SCREEN OR ALLOW ANY 
INTERVIEWER ENTRIES FOR THE ASSOCIATF D RESPONSE 
ALTERNATIVES.] Did ynu [plan lo (IF B.6.b = 2)] transfer the credits, courses, 
or clock hours to (fill in name of school/college K) from; (1 = YES, 2 = NO) 

(1) (Fill in name of NPSAS school)? 

(2) (Fill in name of fust listed school in B.2, if applicable.)? 

(3) (Fill in name of second li.sled sihcwl in B.2, if applicable.)? 

(4) (Fill in name of third listed school in B.2, if applicable.)? 

(5) (Fill in name of fourth listed school in B.2, if applicable.)? 



[IF B.6.a = 1, GO TO B.6.c; ELSE, IF K = 1, GO TO B.7; OTHERWISE, REPEAT B.6.a 
FOR NEXT SCHOOL.] 

1B.6.C IS REPEATED FOR ANY SCHOOL FOR WHICH RESPONSE TO 6.b IS "YES"; 
LIMIT OF CURRENT VALUE OF K] 

c. How many credits, clock hours, or courses did you transfer from (fill in name of 
transferred-from school) to (fill in name of transferred-to school)? 

CREDITS; Were these: 

(1) Clock hours? 

(2) Semester hours? 

(3) Quarter hours? 

(4) Other type of cretlit? SPECIFY: 

[IF NECESSARY, REPEAT B.6.c FOR ADDITIONAL TRANSFERRED-FROM SCHOOLS; 
ELSE, IF K = 1, GO TO B.7; OTHERWISE, REPEAT B.6.a. FOR NEXT SCHOOL.] 

d. Did you transfer (or plan to transfer) any credits, courses, or clock hours from (fill in 
name of school K) back to (fill in name of NPSAS school) [and (fill in names of 
schools 1 through K-1 from B.2) (IF K > 1)]? 

(1) YES, TRANSFERRED CREDITS BACK TO ONE OR MORE OF THE 
OTHER SCHOOLS (GO TO B.6.e). 

(2) YES, PLANNED (OR PLAN) TO TRANSFER CREDITS TO ONE OR 
MORE OF THE OTHER SCHOOLS (GO TO B.6.e) 

(3) NO. (GO TO B.6.g) 

e. [IF K = 1, FILL IN ALTERNATIVE 1 OF B.6.e AS "YES" AND ALL OTHER 
OPTIONS AS "NA". THEN GO TO B.6.f IF RESPONSE TO B.6.d WAS 1. OR TO 
B.7 IF RESPONSE TO B.6.d WAS 2. ASK QUESTION IF K > 1. IF 4 > K > 

1, FILL IN ALTERNATIVES K + 1 THROUGH 5 WITH "NA" AND DO NOT 
FILL IN THOSE SCHOOLS ON SCREEN OR ALLOW ANY INTERVIEWER 
ENTRIES FOR THE ASSOCIATED RESPONSE ALTERNATIVES.] Did you [plan 
to (IF B.6.d = 2)] transfer credits, courses, or clock hours from (fill in name of 
school/college K) to: (1 = YES, 2 = NO) 

(1) (Fill in name of NPSAS school)? 

(2) (Fill in name of first listed school in B.2)? 

(3) (Fill in name of second listed school in B.2)? 

(4) (Fill in name of third school listed in B.2, if any)? 

(5) (Fill in name of fourth school listed in B.2, if any)? 

IIF F\6.d - 1 GO TO B.6.f; ELSE, IF K = 1, GO TO B.7; OTHERWISE, REPEAT B.6.a 
FOR NEXT SCHOOL.] 

(B.G.f IS REPEATED FOR ANY SCHOOL FOR WHICH RESPONSE TO B.6.e WAS 
"YES"; LIMIT OF CURRENT VALUE OF K.) 
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f. How many credits, clock hours, or courses did you transfer from (fill in name of 

transferred-from school) to (fill iu name of transferred -to school)? 



CREDITS; were these 

(1) CLOCK HOURS? 

(2) SEMESTER HOURS? 

(3) QUARTER HOURS? 

(4) OTHER TYPE OF CREDIT? SPECIFY 

[REPEAT B.6.f IF NEEDED; ELSE, IF K = 1, GO TO B.7; OTHERWISE 
REPEAT B.6.a FOR NEXT SCHOOL] 



g. What was the reason you enrolled in (fill in name of school)? 

(1) Beginning course of study in new field or occupation 

(2) Taking courses to help me better to do my job 

(3) Taking courses of practical use (not job or career related) or personal 
enrichment 

(4) Other: SPECIFY 

[IF K = 1, GO TO B.7; OTHERWISE. REPEAT B.6.a FOR NEXT SCHOOL.] 

[REPEAT B.7 FOR ALL TERMS SINCE OR DURING FEBRUARY 1989, IN NPSAS SCHOOL 
AND THE FIRST, SECOND, ETC. OTHER SCHOOL/COLLEGE (INCLUDING PRELOADS). 
LIMIT 12 TERM/SCHOOL COMBINATIONS TOTAL. STORE WITH EACH REPEAT BLOCK 
AN INDICATOR OF SCHOOL AND TERM WITHIN SCHOOL.] 



7. (TIME STAMP ON EACH REPEAT OF THIS SCREEN) 



a. During the term from (starting and ending dates of first enrollment for credit, 
beginning with the first term that includes or follows February 1989) at (name of first 
school/college in which enrolled during or after February 1989), did you attend school 
full time, or part time (as defined by the institution)? 

(1) FULLTIME. 

(2) AT LEAST HALF TIME, BUT LESS THAN FULL TIME. 

(3) LESS THAN HALF TIME. 

b. How many different courses did you take during this term? 

c. At the beginning of the term (FILL IN DATES) at (FILL IN SCHOOL NAME) how 
many credits, clock hours, or contact hours were you enrolled for? 

• CREDITS. [9997 = NONE] 



d. Were these credits 

1 = Clock or contact hours for total term? 

2 = Clock or contact hours weekly 

3 = Semester hours? 

4 = Quarter hours? 

5 = Some other credit system not mentioned above. (SPECIFY.) 
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e. 



At the end of the term, how many credits did you earn [NOTE 7.c FILLED IN AS 
RESPONSE IN EVENT R SAYS "ALL"]? 
CREDITS. [9997 = NONE] 



f. How were you classified by (FILL IN SCHOOL NAME) during this term (FILL IN 
DATES)? (READ CHOICES FIRST TIME THROUGH; SUBSEQUENTLY. READ 
AS NECESSARY.) 

(1) FIRST-YEAR OR FRESHMAN. 

(2) SECOND YEAR OR SOPHOMORE. 

(3) THIRD YEAR OR JUNIOR. 

(4) SENIOR. 

(5) SPECIAL STUDENT (NONMATRICULATED). 

(6) OTHER (SPECIFY). 

g. Were you (still [IF SECOND OR LATER TERM IN SAME SCHOOL AND PRIOR 
REPEAT OF 7h. WAS NOT "YES"]) working toward a license or certificate in your 
coursework this term? 

(1) YES. 

(2) NO. (GO TO 7.ra.) 

h. [ASK ONLY IF IN SECOND OR LATER TERM IN SAME SCHOOL, AND 
PREVIOUS RESPONSE TO 7.k. WAS NOT "YES", OTHERWISE GO DIRECTLY 
TO 7.i] was it the same certificate or license as in the last term at this school? 

(1) YES (FILL IN 7.i AND 7.j WITH RESPONSE TO 7.i AND 7.j IN LAST 
REPEAT AND GO TO 7.k) 

(2) NO (CONTINUE WITH 7.i.) 

i. Were you working toward a certificate or a license? 

(1) CERTIFICATE 

(2) LICENSE 

j. In what? 



k. Did you complete the work toward the certificate or license during this term? 

(1) YES. (GO TO 7.1.) 

(2) NO. (G0T0 7.m.) 

1. Did you obtain the certificate or license? 

(1) YES. 

(2) NO. 

m. Were you (still [IF SECOND OR LATER TERM IN SAME SCHOOL AND PRIOR 
REPEAT OF 7.r. WAS NOT "YES"]) enrolled in a specific degree program or some 
other formal award program? 

(1) Yes. (G0T0 7.n) 

(2) No. (IF LAST REPEAT OVER TERMS FOR ALL SCHOOLS, GO TO 

B.8; OTHERWISE, REPEAT 7.a FOR NEXT TERM AT THIS 
SCHOOL, OR FOR NEXT SCHOOL, AS APPLICABLE.) 
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[ASK ONLY IF SECOND OR LATER TERM IN SAME SCHOOL; AND PRIOR 
REPEAT OF 7.r. WAS NOT "YES"; OTHERWISE, GO DIRECTLY TO 7.o.] Was 
this the same degree you told us about for the previous term at this school? 

(1) YES (FILL IN 7.0 WITH RESPONSE TO 7.o IN LAST REPEAT FOR 
THIS SCHOOL, AND GO TO 7.p.) 

(2) NO (CONTINUE WITH 7.o.) 

What kind of degree or other formal award were you working toward at that time? 
(READ CHOICES AS NECESSARY.) 

(1) TWO- OR THREE-YEAR VOCATIONAL DEGREE OR DIPLOMA. 

(2) TWO-YEAR ACADEMIC DEGREE (E.G., ASSOCIATE OF ARTS OR 
SCIENCE.) 

(3) FOUR- OR FIVE-YEAR BACHELOR'S DEGREE. 

(4) MASTER'S DEGREE OR EQUIVALENT. 

(5) FIRST PROFESSIONAL DEGREE (e.g., MD, DDS). 

(6) DOCTORATE (e.g., Ph.D., Ed.D.). 

[IF SECOND OR LATER TERM IN SAME SCHOOL, ASK 7.p; OTHERWISE, GO 
TO 7.q] 

Was your major field of study the same in this term as you told us for the last term? 

(1) YES [FILL IN 7.q WITH INFORMATION FROM 7.q OF LAST REPEAT 
WITHIN THIS SCHOOL AND GO TO 7.r.] 

(2) NO [CONTINUE WITH 7.q] 

What was your major field of study during this term? 



r. Did you finish all work required for the degree or award during this term? 

(1) YES. 

(2) NO. 

(IF LAST REPEAT OVER TERMS FOR ALL SCHOOLS, GO TO B.8; 
OTHERWISE, REPEAT 7. a FOR NEXT TERM AT THIS SCHOOL OR FOR 
NEXT SCHOOL, AS APPROPRIATE.) 

[B.8, AND B.9 ARE REPEATED FOR ALL SCHOOLS/COLLEGES, ATTENDED (INCLUDING 
NPSAS SCHOOL PRELOADED "OTHERS", AND "NEW OTHERS"), LIMIT=5.] 

8. (TIME STAMP ON EACH REPEAT OF THIS SCREEN.) I am now going to read you a list 
of school-related activities that you may or may not have participated in at any time while at 
(name of current school/college being considered). Please answer (1) Never, (2) Once, (3) 
Several Times, or (4) often. Roughly, how often ner term did you... 

[NOTE: PICK A RANDOM START POINT BETWEEN a AND 1, AND STORE THIS 
START POINT AS A VARIABLE. PRESENT ITEMS IN ORDER, STARTING AT THE 
RANDOM POINT AND WRAPPING AS NECESSARY.] 

(a) Talk with faculty about academic matters outside of class time? 

(b) Meet with advisor concerning academic plans? 
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(c) Have informal or social contacts with advisor or other faculty members outside of 
classrooms/office? 

(d) Participate in study groups with other students outside of the classroom? 

(e) Go places with friends from the school (e.g., concerts, movies, restaurants, sporting 
events)? 

(f) Participate in one or more student assistance centers or programs (e.g., counseling 
programs, learning skills center, minority student services, health services)? 

(g) Participate in school clubs (e.g., student government, religious clubs, service 
activities)? 

(h) Attend career-related lectures, conventions, or field trips with friends? 

(i) Participate in and practice with others for music, drama, choir, etc.? 

(j) Participate in and practice with othr -s for intramural or nonvarsity sports? 
(k) Pariicipate in and practice with others for intercollegiate or varsity sports? 
(1) Were you concerned about personal safety while on campus or at school? 

9. While you were enrolled in (name of first school/college), how satisfied were you with the 

following? (1) Very Dissatisfied, (2) Somewhat Dissatisfied, (3) Somewhat Satisfied, (4) Very 
Satisfied, or (5) Not Applicable. 

[NOTE: PICK A RANDOM START POINT BETWEEN a AND s AND STORE THIS 
START POINT AS A VARIABLE. PRESENT ITEMS IN ORDER, STARTING AT THE 
RANDOM POINT AND WRAPPING AS NECESSARY.] 



(a) 


The teaching ability of most of the teachers. 


(b) 


The knowledge of most of the teachers. 


(c) 


The social life. 


(d) 


Development of your work skills and habits. 


(e) 


Your intellectual growth. 


(f) 


Special tutoring or remedial instruction 


(g) 


Academic counseling. 


(h) 


Financial aid counseling. 


(i) 


Personal counseling. 


(j) 


Career or job counseling. 


(k) 


Job placement. 


(1) 


The classroom buildings, library, equipment, etc. 


(m) 


Cultural activities, music, art, drama, etc. 


(n) 


The intellectual life of the school. 


(0) 


The course curriculum. 


(P) 


The quality of the instruction. 


(q) 


Sports and recreation facilities. 


(r) 


The fmancial cost of attending. 


(s) 


The prestige of the school. 



[IF FINISHED REPEATS OVER ALL SCHOOLS. CONTINUE WITH B.IO; OTHERWISE, 
REPEAT B.8 AND B.9 FOR NEXT SCHOOL.] 
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(TIME STAMP ON TH'S SCREEN.) During the period from July 1, 1988 through June 30, 
1989 while you were enrolled in (fill a name(s) of aU school (s)/college(s) in which enrolled 
during the time period), please estimate how well you did in all your coursework. (READ 
CHOICES AS NECESSARY.) 

(a) Mostly A^s (3.75-4.00 grade point average). 

(b) A's and B's (3.25-3,74 grade point average). 

(c) Mostly B's (2.75-3.24 grade point average). 

(d) B's and C's (2.25-2.74 grade point average). 

(e) Mostly C's (1.75-2.24 grade point average). 

(f) C*s and D's (1 .25-1.74 grade point average). 

(g) Mostly D's cr below (less than 1.25). 

(h) Other (e.g., non-graded, pass/fail). 

riF NOT ENROLLED DURING OR AFTER JULY 1989, THEN FILL IN B.ll WITH 
RESPONSE TO B.IO AND GO TO B.12; IF ENROLLED DURING OR AFTER JULY 
1989 THEN ASK QUESTION]. During the entire period between July 1988 through the 
presem while you were enrolled in (FILL IN NAME(S) OF ALL SCHOOL(S)/COLLEGE(S) 
in which enrolled during the time period), please estimate how well you have done m all your 
coursework. (READ CHOICES AS NECESSARY). 

(a) Mostly A's (3.75-4.00 grade point average). 

(b) A*s and B's (3.25-3.74 grade point average). 

(c) Mostly B's (2.75-3.24 grade point average). 

(d) B's and C*s (2.25-2.74 grade point average). 

(e) Mostly C*s (1.75-2.24 grade point average). 

(f) C's and D's (1.25-1.74 grade point average). 

(g) Mostly D's or below (less than 1.25). 

(h) Other (e.g., non-graded, pass/fail). 

(TIME STAMP ON THIS SCREEN.) During the period from July 1988 through June 1989, 
when you were enrolled in (name(s) of school(s)/college(s) in which enrolled during time 
period), how frequently did you receive the following assistance from your school(s)? (1) 
Never, (2) 1-3 Times, (3) 4 or More Times. 

(a) Additional instruction or tutoring for specific courses. 

(b) Remedial instruction or tutoring to improve basic writing and computational skills. 

(c) Career counseling. 

(d) Counseling related to academic coursework. 

(e) Financial aid counseling. 

(f) Personal counseling. 

(g) Jot) placement assistance. 
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13. (IF ENROLLED IN ANY SCHOOL/COLLEGE BETWEEN JULY 1989 THROUGH JUNE 
1990 ASK THIS QUESTION; OTHERWISE GO TO B.14.) During the period between July 
1989 and June 1990, when you were enrolled in (fdl in name(s) of school(s)/coIIege(s) in 
which enrolled during time period), how frequenUy did you receive the following assistance 
from your school(s)? (1) Never, (2) 1-3 Times, (3) 4 or More Times. 

(a) Additional instruction or tutoring for specific courses. 

(b) Remedial instruction or tutoring to improve basic writing and computational skills. 

(c) Career counseling. 

(d) CouHvSeling related to academic coursework, 

(e) Financial aid counseling. 
(0 Personal counseling. 

(g) Job placement assistance. 

14. (IF ENROLLED IN ANY SCHOOL/COLLEGE BETWEEN JULY 1990 THROUGH 
PRESENT ASK THIS QUESTION; OTHERWISE GO TO B.15,) During the period between 
July 1990 and now, when you were enrolled in (fill in name(s) of school(s)/college(s) in 
which enrolled during time period), how frequently did you receive the following assistance 
from your school(s)? (1) Never, (2) 1-3 times, (3) 4 or More Times. 

(a) Additional instruction or tutoring for specific courses. 

(b) Remedial instruction or tutoring to improve basic writing and computational skills. 

(c) Career counseling. 

(d) Counseling related to academic coursework. 

(e) Financial aid counseling, 

(f) Personal counseling. 

(g) Job placement assistance. 

15, (TIME STAMP ON EACH REPEAT OF THIS SCREEN, IF ASKED. IF ANY OF 
SERVICES (a-g) LISTED IN B.12, B.13, OR B, 14 WERE RECEIVED, (i.e., RESPONSES 
OF 2 OR 3) IN ANY YEARS, ASK THE FOLLOWING FOR EACH SERVICE RECEIVED, 
[ALLOW RESPONSES TO B,15 AND B,16 FOR EACH OF THE SEVEN SERVICES]; 
OTHERWISE, GO TO SECTION C) When you received (fill in name of service received), 
how was the service most often provided? 

(a) In group sessions. 

(b) Individually, 

(c) Both, 

16, Who was the primary provider of (fill in name of service received)? (READ CHOICES AS 
NECESSARY.) 

(a) FINANCIAL AID OFFICE STAFF, 

(b) JOB PLACEMENT OFFICE STAFF, 

(c) FACULTY. 

(d) STUDENTS, 

(e) OTHER PROFESSIONALS. 
(0 COMPUTER ASSISTED. 

(g) OTHER (SPECIFY), . 
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Education Financing (TIME STAMP ON SECTION C START SCREEN) 



[IF NO POSTSECONDARY EDUCATION SINCE FEBRUARY 1989, GO TO SECTION D] 

The next few questions are about your education finances. Costs include tuition (what you pay to take 
classes) and extra fees for laboratory use or other school sponsored services (like athletics or health). 
Other costs include transportation, books, room and board, equipment needed and" so forth. We would 
like you to estimate the costs of tuition and fees separately from the other costs. We are interested in 
full costs, regardless of whether they were paid by you, your parents, or some form of financial aid. 
Financial aid includes grants, scholarships, student loans, work-study, fellowships, assistantships, and 
assistance with education from an employer or from the military. It does not include financial 
assistance from family or friends. As we did earlier, we will be asking the questions for each term in 
which you were enrolled. (IF WORKSHEET CODE = 3 AND (A.2A.d = 1 OR A.2B.b = 1), 
CONTINUE WITH INTRODUCTION; OTHERWISE GO TO C. 1)] These questions are also related 
to the worksheet we sent you. and it will probably help if you consult the worksheet at this time. 

[C.1 THROUGH C.5 ARE REPEATED FOR EACH TERM A T EACH SCHOOL IDENTIFIED IN 
SECTION B (NPSAS SCHOOL, PRELOAD AND "OTHERS"--LIMIT OF 12 SCHOOL/TERM 
COMBINATIONS. EACH REPEAT BLOCK SHOULD INCLUDE VARIABLES IDENTIFYING 
THE SCHOOL AND TERM WITHIN SCHOOL REFERENCED.] 

1. (TIME STAMP ON EACH REPEAT OF THIS SCREEN) For (fill in name of first, second, 
third, etc., school /col lege in which enrolled during or after February 1989), let's talk about the 
term from (starting and ending dates of first enrollment for credit, beginning v/ith the first 
term that includes or follows February 1989). About how much were the tuition and fees 
before any financial aid or waivers? $ 

(NOTE TO INTERVIEWER: IF RESPONDENT CANT FIGURE THIS OUT BY TERM. 
ASK THEM TO FIGURE THE FULL YEAR COSTS AND DIVIDE BY NUMBER OF 
TERMS.) 

2. How much were the expenses for books and supplies, room and board, and other related 
educational expenses? $ 

3. a. Where did you live during this term? (READ CHOICES FIRST TIME THROUGH; 

SUBSEQUENTLY READ AS NECESSARY) 

(1) IN SCHOOL-PROVIDED HOUSING. 

(2) IN A SORORITY /FRATERNITY HOUSE. 

(3) IN YOUR OWN APARTMENT OR HOUSE (NOT WITH PARENTS), 

(4) WITH PARENTS OR GUARDIAN. 

(5) WITH RELATIVES, OTHER THAN PARENTS, SPOUSE, OR 
CHILDREN. 

(6) OTHER SITE. (SPECIFY) 

[IF RESPONSE TO CJ.a IS 4 OR 5, CONTINUE WITH C.3.b; OTHERWISE GO TO C.4] 

b. Did you include the costs of your room and board while living with [(parents or 

guardians) (IF C.3.a = 4)/relative (IF C.3.a = 5)] as part of your other education 

expenses? 
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(1) YES. 

(2) NO. 



4, Did you receive financial aid for the (fill in starting and ending dates of the term being 

discussed) term at (name of school/college at which enrolled during that term) [FOR FIRST 
TIME THROUGH ONLY ADD THE FOLLOWING: Please do not include financial 
assistance from family or friends.]? 

(1) YES. (GO TO C.5.) 

(2) NO. (IF LAST REPEAT OF C.i-C.5 GO TO C.6; OTHERWISE GO BACK TO 

REPEAT OF C.l) 

5. What kind(s) of financial aid was this? Did you receive: (1 = YES OR 2=N0 TO EACH. 
READ CHOICES ON FIRST REPEAT, ON SUBSEQUENT REPEATS, READ AS 
NECESSARY.) 

a. GRANT(S) OR SCHOLARSHIP(S). 

b. WORKSTUDY 

c. STUDENT LOAN(S), OTHER THAN LOAN(S) FROM FAMILY OR FRIENDS 
OR LOANS TO PARENTS. 

d. TUITION BENEFITS OR OTHER EDUCATION SUBSIDIES FROM EMPLOYER 
OR UNION. 

e. OTHER. (SPECIFY) ^ 



[IF LAST REPEAT OF C.l - C.5, CONTINUE WITH C.6; OTHERWISE, GO TO CI FOR 
ADDITIONAL REPEAT] 

6. (ASK ONLY IF, FROM APPROPRIATE REPEATS OF C.4, ANY FINANCIAL AID WAS 
RECEIVED FOR ANY TERM IN ANY SCHOOL/COLLEGE FOR THE 1989-90 SCHOOL 
YEAR: JULY 1989 - JUNE 1990) (TIME STAMP ON THIS SCREEN, IF ASKED) 

a. What was the total amount of financial aid received (i.e., awarded and accepted) from 
all sources, except parents , family, and friends , from July 1989 - June 1990? 
(INFORMATION REQUESTED HERE IS FINANCIAL AID ACTUALLY USED. 
IF FINANCIAL AID WAS APPROVED BUT STUDENTS DID NOT ACCEPT OR 
USE THE AID, IT SHOULD NOT BE INCLUDED.) $ 

b. What percent of your total postsecondary education expenses, including living 
expenses while in school, was met by the financial aid for the 1989-90 school year 
(July 1989-June 1990) (TIME STAMP ON THIS SCREEN, IF ASKED)? 
% [COMPUTE TOTAL COSTS DURING 1989-90 SCHOOL YEAR 

INCLUDING SUMMER TERMS IN 1989 (FROM 
APPROPRIATE ADDITIONS OF C.l AND C.2 REPEATS); 
THEN DIVIDE RESPONSE TO C6.a BY THAT 
COMPUTATION AND EXPRESS RESULT AS A 
PERCENTAGE TO BE STORED SEPARATELY . SUBTRACT 
THE COMPUTED PERCENTAGE FROM RESPONSE TO 
C.6.b AND STOP': THE VALUE OF THE DIFFERENCE . IF 
THE TWO PERCENTAGES DIFFER (ABSOLUTE VALUE) 
BY 10 PERCENTAGE POINTS OR LESS, CONTINUE WITH 
C.7; OTHERWISE, ASK C.6.C.] 
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c. The estimated percentage you just gave us differs from th percentage computed from 

the answers you gave previously. Comparing your pervious estimates of expenses and 
fmancial aid during the 1989-90 school year, we obtained [FILL IN WITH 
COMPUTED PERCENTAGE] percent. Do you think seme of the information you 
gave us is wrong? 

(1) COMPUTED PERCENTAGE IS PROBABLY CORRECT. [FILL IN C.6.b. 
WITH COMPUTED PERCENTAGE.] 

(2) PROBABLY MISSESTIMATED TUITION AND FEES EXPENSES. 

(3) PROBABLY MISSESTIMATED OTHER EDUCATION EXPENSES. 

(4) PROBABLY MISSESTIMATED AID RECEIVED. 

(5) OTHER (SPECIFY) __. 

(ASK ONLY IF, FROM APPROPRIATE REPEATS OF C.4, ANY FINANCIAL AID 
RECEIVED FOR ANY TERM IN ANY SCHOOL/COLLEGE FOR THE 1990-91 SCHOOL 
YEAR: JULY 1990 - JUNE 1991) (INCLUDING THE SUMMER SESSIONS OF 1990) 
(TIME STAMP ON THIS SCREEN, IF ASKED) 

a. What was the total amount of tinancial aid received (i.e., awarded and accepted) from 
all sources, except parents, family, and friends , for the 1990-91 school year (July 
1990 - current term)? (INFORMATION REQUESTED HERE IS FINANCIAL AID 
ACTUALLY USED . IF FINANCIAL AID WAS APPROVED BUT STUDENT 
DID NOT ACCEPT OR USE THE AID, IT SHOULD NOT BE INCLUDED) 

$ 

b. What percent of your total postsecondary education expenses, including living 
expenses while in school, was met by the financial aid for the 1990-91 school year? 
% (COMPUTE TOTAL COSTS DURING 1990-91 SCHOOL 

YEAR INCLUDING SUMMER TERMS IN 1989 (FROM 
APPROPRIATE ADDITIONS OF C.l AND C.2 REPEATS); 
THEN DIVIDE RESPONSE TO C.7,a BY THAT 
COMPUTATION AND EXPRESS RESULT AS A 
PERCENTAGE TO BE STORED SEPARATELY . 
SUBTRACT THE COMPUTED PERCENTAGE FROM 
RESPONSE TO C.7,b AND STORE THE VALUE OF THE 
DIFFERENCE . IF THE TWO PERCENTAGES DIFFER 
(ABSOLUTE VALUE) BY 10 PERCENTAGE POINTS OR 
LESS, CONTINUE WITH C,8; OTHERWISE ASK C.7.C.] 

c. The estimated percentage you just gave us differs from the percentage computed from 
the answers you gave previously. Comparing your previous estimates of expenses and 
Financial Aid during the 1990-91 school year, we obtain [FILL IN WITH 
COMPUTED PERCENTAGE] percent. Do you think some of the information you 
gave us is wrong? 

(1) COMPUTED PERCENTAGE IS PROBABLY CORRECT. [FILL IN C.7.b 
WITH COMPUTED PERCENTAGE.] 

(2) PROBABLY MISSESTIMATED TUITION AND FEES EXPENSES. 

(3) PROBABLY MISSESTIMATED OTHER EDUCATION EXPENSES 

(4) PROBABLY MISSESTIMATED AID RECEIVED 

(5) OTHER (SPECIFY) . 
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8. (TIME STAMP ON THIS SCREEN) 

a. Since February 1989 have you ever been offered any student financial aid that you 

didn*t accept? 

(1) YES. (GOTOC.S.b.) 

(2) NO. (GO TO C.9.) 

b. Which of the following reasons describe why you did not accept the aid: 
(1) YES, (2) NO. 

A. You didnU need the assistance? 

B. Had a better offer at another school? 

C. You were offered a loan and you didn't want to go into debt? 

D. You were offered work-study, but work would have interfered with school? 

E. You were offered work-study, but could have earned more from other 
employment? 

F. Other reason? (SPECIFY) 

9. For the entire time you were in school since February, 1989, did you use money for your 
education or associated living expenses from any of the following sources? 
(1) YES, (2) NO. 

a. Personal earnings or savings? 

b. Spouse earnings or savings? 

c. Contributions from parents (not to be repaid)? 

d. Loans from parents (to be repaid)? 

e. Contribution from other relatives (not parents) or friends? 

f. Loans from other relatives (to be repaid) or friends? 

g. Other income? (SPECIFY) 

h. Other loans. (SPECIF Y)_ 

10 (IF YES TO ANY REPEAT OF C.5x, OR TO 9.d., 9.f., or 9.h. OR IF NPSAS DATA 
INDICATES YES TO OWE ON LOANS (i.e., PRIORLN = l) ASK THIS QUESTION; 
OTHERWISE SKIP TO C.12) 

a. Do you currently owe any money on loans for postsecondary education? 

(1) YES. (GO TO lO.b.) 

(2) NO. (GOTO C. 12.) 

b. How much do you currently owe? $ 



11. In order to have a portion of this debt forgiven, would you be willing to do any of the 
following? (t)YES, (2) NO. 

a. Teach or perform other public service work in a depressed area of the U.S., such as a 
rural area or inner city? 

b. Entei national service such as Consei-vation Corps, Peace Corps, or VISTA? 

c. Enter the military? 
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12. (IF NPSAS DEPENDENCY STATUS IS AVAILABLE, ASK 12.a; OTHERWISE START 
WITH 12.b) 

a. You previously told us you [were (IF NPSAS DEPENDENCY STATUS = l)/were 
not (IF NPSAS DEPENDENCY = 2)] listed as a dependent on your parent's income 
tax return for 1988. Is that correct? 

(1) YES (IF NPSAS DEPENDENCY STATUS = 1, FILL IN C.12.b 

AS "YES" AND GO TO C.12.C. IF NPSAS DEPENDENCY 
STATUS = 2, FILL IN C.12.b. AS "NO", AND GO TO 
SECTION D.) 

(2) NO (G0T0C.12.b) 

b. Were you listed as a dependent on your parent's income tax return for 1988? 

(1) YES (CONTINUE WITH C.12.C) 

(2) NO (GO TO SECTION D) 

c. Were you listed as a dependent on your parents' income tax return for 1989? 

(1) YES (CONTINUE WITH C.i2.d.) 

(2) NO (GO TO SECTION D.) 

d. For 1990? 

(1) YES. 

(2) NO, 



Work Experiences (TIME STAMP ON SECTION D START SCREEN) 

The next few questions concern any jobs you may have held (for pay) during or since February of 
1989. This includes jobs that you started before that time, but you were still employed in during or 
after February 1989. If you left job and sometime later went back to the same job, please count that 
as two jobs for purposes of these questions. We want you to consider any job you held for pay , 
including summer jobs, work-study jobs, apprenticeships, and co-ops. (IF WORKSHEET GROUP = 
2 AND (2.A.d = I OR 2,B,b - 1)), CONTINUE WITH INTRODUCTION; OTHERWISE GO TO 
D.l). The questions are related to the worksheet we sent you, and it will probably s-peed up the 
interview if you refer to the worksheet at this time. 

1. Have you held a job for pay at any time (including co-ops, work study, summer jobs, and 
part-time jobs such as in the National Guard or military reserve), either full time or part time, 
since February 1989? 

a, YES, (GO TOD. 2.) 

b. NO. (GOTO SECTION E.) 

2. How many different jobs have you held for pay since February 1989? 
JOBS. 

[REPEAT D.3 THROUGH D.19 FOR EACH JOB AS IDENTIFIED IN D.2 HELD FOR PAY 
DURING OR SINCE FEBRUARY 1989; LIMIT TO 6.] 
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(TIME STAMP ON THIS SCREEN FOR EACH REPEAT) 

a. For the [first, second, etc., depending on number of repeat-based on D.2] job tor pay 
that you held since February 1989, who v/as your employer? 

(Name of company, business, organization or other employer) 

b. What kind of business or industry was this (for example: hospital, newspaper 
publishing, mail order house, auto engine manufacturing, breakfast cereal 
manufacturing)? 



c. Was this job mainly? 

1) Manufacturing 

2) Wholesale trade 

3) Retail trade 

4) Other (agriculture, construction, service, government, etc.) 

d. Was this job a seasonal or a full-year job? 

(1) SEASONAL. (G0T0 3.e) 

(2) FULL-YEAR JOB. (GO TO D. 0 

e. When did this seasonal job normally start and end? 

START: , END: 

month month 

a. When did you start working for pay for this (fir .t, second, etc.„ (depending on which 

job is being discussed) employer]? 

Start: 

month year 

b. Are you still employed for pay at this job.' 

(1) YES. (FILL IN BOTH PARTS OF D.4.C WITH "NA" AND GO TO D.5) 

(2) NO. (GOTOD.4.C) 

c. When did you leave this job? 
month year 

Was this a ''co-op" job or paid internship/apprenticeship associated with an educational 
program you were enrolled in at the time? 

(1) YES. 

(2) NO. 

How closely was this job related to your plannexl area of study at that time? 

1 = CLOSELY RELATED. 

2 = SOMEWHAT RELATED. 

3 = NOT RELATED. 
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7. (IF EMPLOYMENT PERIOD OVERLAPS PERIOD OF ENROLLMENT IN 
SCHOOL/COLLEGE:) Since you were also in school during the time you were working at 
this job, wa5; thi*^ job nn campus or off campus? 

(1) ' ON CAMPbS. 

(2) OFF CAMPUS. 

(IF JOB WAS NOT MORE THAN THREE MONTHS AND IS NOT LAST JOB, FILL IN D.8 - 
D.12 AS "NA" AND GO TO D.I3; OTHERWISE CONTINUE WITH D.8) 

8. (TIME STAMP ON EACH REPEAT SCREEN OF D.8) 

a. What kind of work was this (for example, registered nurse, personnel manager, 
salesperson, waitress, gasoline engine assembler, or MOS if military)? 

(Fill in) 

h. WTiat were your most important duties (for example; patient care, directing hiring 
practices, supervising order clerks, assembling engines, operating grinding mill)? 



(Fill in) 

9. What type of company or organization was this? (READ CHOICES) 

(1) PRIVATE FOR-PROFIT. 

(2) PRIVATE NOT-FOR-PROFIT OR NON-PROFIT. 

(3) FEDERAL GOVERNMENT. 

(4) STATE GOVERNMENT. 

(5) LOCAL GOVERNMENT. 

(6) SELF EMPLOYED IN YOUR OWN BUSINESS, PROFESSIONAL PRACTICE, 
OR FARM (NOT INCORPORATED) 

(7) SELF EMPLOYED IN YOUR OWN BUSINESS, PROFESSIONAL PRACTICE OR 
FARM (INCORPORATED) 

(8) OTHER. (SPECIFY) 



K). Wben you started this job, how many hours per week did you usually work? 



hours 

II. V\Tiat was the minimum level of education required for this job? (READ CHOICES AS 
NECESSARY) 

(1) HIGH SCHOOL OR LESS. 

(2) LESS THAN 1 YEAR OF OCCUPATIONAL, TRADE, TECHNICAL, OR 
BUSINESS SCHOOL. 

(3) \ BUT LESS THAN 2 YEARS OF OCCUPATIONAL, TRADE, TECHNICAL, OR 
BUSINESS SCHOOL. 

(4) 2 YEARS OR MOLE OF OCCUPATIONAL, TRADE, TECHNICAL, OR 
BUSINESS SCHOOL. 

(5) LESS THAN 2 YEARS OF COLLEGE. 

(6) 2 OR MORE YEARS OF COLLEGE (INCLUDING 2-YEAR DEGREE). 

(7) COMPLETE BACCALAUREATE DEGREE (4 OR 3 YEAR DEGREE). 

(8) MASTER\S DEGREE OR E^QUIVALENT. 

(9) Ph.D., M.D., OR OTHER ADVANCED PROFESSIONAL DEGREE 
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a. What was your starting salary (before taxes and including tips or commissions)? 
$ 

b. Was this: (READ CHOICES AS NECESSARY) 



(1) 


HOURLY? 


(2) 


DAILY? 


(3) 


WEEKLY? 


(4) 


BIWEEKLY? 


(5) 


MONTHLY? 


(6) 


YEARLY? 


(7) 


OTHER (E.G.. PER SEASON) (SPLCIFY) 



c. (IF DAILY) How many days per week /'.id you usually work? 

(TIME STAMP FOR EACH REPEAT OF D.13) 

a, What was your final or last salary (before taxes and including tips or commissions)? 
$ 

b. Was this: (READ CHOICES AS NECESSARY) 



(1) 


HOURLY? 


(2) 


DAILY? 


(3) 


WEEKLY? 


(4) 


BIWEEKLY? 


(5) 


MONTHLY? 


(6) 


YEARLY? 


(7) 


OTHER (E.G., PER SEASON) (SPECIFY) 



c. (IF DAILY) How mfmy days per week did you usually work? 

a. (IF D.4.C NA) Whtm you left this job, how nuny hours per week did you usually 
work? (GO TO D 15) 



b. (IF DA.c - NA) How many hours per week do you usually work now? 



(IF PART TIME; I.E.. LESS THAN 35 HOURS PER WEEK AT END OF PERIOD): 

a. Was this considered full lime? 

(1) YES. (GOTO D. 16.) 

(2) NO. (GOTO L5.b) 

b. Did you want to w(»rk full time? 

(1) YES 

(2) NO 

(IF FULL TIME; I.E., 35 HOURS OR MORE PER WEEK AT END OF PERIOD OR 
CONSIDERED FULLTIME FROM 15.a): 

Did yon pdrlicipate in employer-provided education/training benefits or program while m this 
job? 

1 YES. (GOTO D.17) 

2 - NO. ((IF THIS IS THE LAST REPEAT OF D,3-D. 10 (BASED ON D.2), GO 

10 D.20.SUM: OTHERWISE, GO TO D.3 FOR ADDITIONAL REPEAT.) 



17. What type of education/training benefits or programs did you participate in? Were they? 
(READ CHOICES AND ENTER YES OR NO TO EACH; 1 = "YES"; 2 = "NO") 

a. FORMAL REGISTERED APPRENTICESHIP, SPONSORED BY THE STATE OR 
A LABOR UNION. 

b. FORMAL EMPLOYER-PROVIDED JOB TRAINING DURING WORKING 
HOURS. 

c. TUITION AID AND/OR FINANCIAL ASSISTANCE FOR ATTENDING 
EDUCATION INSTITUTIONS. 

d. INFORMAL ON-THE-JOB TRAINING; THAT IS, ASSIGNED TO WORK WITH 
SOMEONE FOR INSTRUCTION OR GUIDANCE. 

e. OTHER (SPECIFY). 

18* On the average, (for all training in this job) how many hours per week did you spend? 

a. Being in.stnicled by a teacher? (hours/week) [97 - NONE] 

b. Outside readin^/homework/practicc/lab work (hours/week). (97 - NONE] 

19. a. What was the length of all progran's for this job? 

[ENTER NUMBER [97 "VOK AS LONG AS EMPLOYED"] 

b, (IF D.19.a = 97, SKIP SCREEN; OThERWISE INTERVIEWER ASKS OR 
SPECIFIES WHETHSR THE D.19,a NUMBER IS IN:) 

(1) DAYS 

(2) WEEKS 

(3) MONTHS 

c. Did you earn any Continuing Education Units (CEUs) for any of these programs? 

(1) YES. 

(2) NO. 

[IF THIS IS THE LAST RFPEAT OF D. 3-D. 19 (BASED ON D.2), GO TO D.20.SUM; 
OTHERWISE, GO To b.3 FOR ADDITIONAL REPEAT] 

iO.SUM [JOBS SHOULD BE SORTED BY START MONTH/YEAR BEFORE 

PRESENTING THIS SCREEN. ALSO FLAG SHOULD BE SET WHEN KST 
REACHING THIS SCREEN TO AVOID A REPEAT, SHOULD BACKTRACK BE 
REQUIRED.] We will ruid a summary of the employment you reported d^iring or 
since February 1989. Is this correct? 

(fill in from D,3.a and D.4,u and c. It b.4.c - "NA" fill in end month as ' PRESENT'') 



Stiirt St:irt End I-.iul 

Job Company Month Year Month Yenr 



2 " ' 19 19 

4 - ■ " - 

0 " ' 19^ 19 
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[PROGRAM TO ALLOW CORRECTION OF COMPANY NAME START AND END 
DATES AND ALLOW A DELETION CODE FOR JOBS LISTED INAPPROPRIATELY, 
DO NOT ADD ON THIS SCREEN . IF ADDITIONAL JOBS, BUMP COUNTER (B.2) 
AND BACKTRACK TO ANOTHER REPEAT OF D.3 THROUGH D.19] 

20. (TIME STAMP ON THIS SCREEN) 

How satisfied were you with your current or latest job? 

1 = SATISFIED. 

2 = NEUTRAL OR NO OPINION. 

3 = DISSATISFIED. 

21. ([¥ EMPLOYED SINCE FEBRUARY 1989 BUT PRIOR TO END OF LAST 
ENROLLMENT PERIOD, ASK THIS QUESTION; OTHERWISE GO TO D.221 During the 
time when you were both working and enrolled in school /col lege, how did you view your 
primary role in postsecondary education? (READ ALL CHOICES.) 

1 = STUDENT WHO WORKS TO HELP PAY EXPENSES WHILE IN 

SCHOOL/COLLEGE. 

2 == STUDENT WHO WORKS TO EARN EXTRA SPENDING MONEY WHILE IN 

SCHOOL/COLLEGE. 

3 = AN EMPLOYEE WHO ATTENDS SCHOOL/COLLEGE TO GAIN SKILLS 

NECESSARY FOR JOB ADVANCEMENT. 

4 = AN EMPLOYEE WHO ATTENDS SCHOOL TO EXPAND NEW CAREER 

POSSIBILITIES. 

5 = AN EMPLOYEE WHO ATTENDS SCHOOL TO EXPAND PERSONAL 

KNOWLEDGE/SKILLS. 

6 = OTHER ^SPECIFY). 

[REPEAT D.22 FOR ALL NON-EMPLOYMENT PERIODS (LIMIT 6)] 

22. (IF ANY PERIODS OF UNEMPLOYMENT - PERIODS WITH A ONE MONTH OR 
MORE SKIP BETWEEN END OF EMPLOYMENT PERIOD AND BEGINNING OF THE 
NEXT EMPLOYMENT PERIOD (OR CURRENT DATE IF NOT CURRENTLY 
EMPLOYED); E.G., END OF EMPLOYMENT IN JUNE. 1989 AND BEGINNING OF 
NEXT EMPLOYMENT IN AUGUST, 1989 OR LATER) (TIME STAMP ON EACH 
REPEAT OF THIS SCREEN) For the period from (months and year of beginning and ending 
of first non-employment period), you reported not being employed. During that period: 

a. Did you receive unemployment insurance? 

(1) YES. 

(2) NO. 

b. Were you looking for work? 

(1) YES. (GOT0 22.C.) 

(2) NO. (IF THIS IS LAST REPEAT OF D.22, GO TO SECTION E; 

OTHERWISE, GO BACK TO SCREEN STARTING D.22 FOR 
ADDITIONAL REPEAT.) 

c. How many hours per week did you spend, on the avorage, looking for work? 
HOURS 

d. What was the lowc-J <^aiary/wai!t: lliat would have been acceptable to yf)U on a 
permanent basis? $^ 




Was this: (READ CHOICES AS NECESSARY) 

(1) HOURLY? 

(2) DAILY? 

(3) WEEKLY? 

(4) BIWEEKLY? 

(5) MONTHLY 

(6) YEARLY? 

(7) OTHER (E.G., PER SEASON) (SPECIFY) 

[IF THIS IS LAST REPEAT OF D.22, GO TO SECTION E; OTHERWISE, GO BACK TO SCREEN 
STARTING D.22 FOR ADDITIONAL REPEAT.] 



E. Other Education or Training 

We have asked you about postsecondary education for credit and education/training that may have been 
provided by your employers. The next few questions involve other education programs, you may have 
participated in. 

(TIME STAMP ON SCREEN STARTING SECTION E) 

1 . Other than postsecondary education for credit, education/training provided by your employer, 
and military training, we woi-.ld like to find out about your participation in any programs such 
as registered apprenticeships, government training programs, personal enrichment, or 
correspondence courses. Since Februaiy 1989, have you participated in any of the following? 
Please report any specific course, course of study, or program in only one category. (READ 
CHOICES) (1) YES, (2) NO. 



a. Non-credit courses or activities in a regular school or college? 

b. Correspondence courses? 

c. Courses given by a community group, b.bor organization, or church? 

d. Courses or instruction from a private instructor? 

e. Courses by television, radio, or newspaper? 

f. Formal apprenticeship (through state or local union)? 

g. A Work Incentive Program (WIN). 

h. Job Corps. 

i. Job Training Partnership Act (JTPA), state, or local employment training program, 
j . Other (SPECIFY) 



IF YES TO ANY CHOICE, GO TO E.2; OTHERWISE GO TO SECTION F. 

2. In how many (category in E.l with ''YES^ START WITH FIRST AND CONTINUE 

THROUGH ALL CATEGORIES WITH YES RESPONSE) did you participate? 
Number 



[REPEAT E,2 FOR ANY OTHER CATEGORY OF OTHER EDUCATION TO WHICH 
RESPONDENT REPLIED YES. FOR "NO" RESPONSES, FILL IN WITH ZERO.] 
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a. Considering the [firt, second, third,... of the {FILL IN PROGRAM TYPE} (IF E.2 
> 1 FOR THIS PROGRAM TYPE)/ {FILL IN PROGRAM TYPE} (IF E.2 = 1 
FOR THIS PROGRAM TYPE)] did you complete that education course or program? 

[NOTE TO INTERVIEWER: IF RESPONDENT VOLUNTEERS THAT "EDUCATION" IS 
A CONTINUING PROCESS WITHOUT AN ESTABLISHED END DATE (E.G., AN 
EXERCISE CLASS OR WEIGHT WATCHERS) DO NOT ACCEPT RESPONSE OPTION 
3. IF THEY LEFT SUCH A PROGRAM, CODE AS RESPONSE OPTION 1 -- (I.E., 
COMPLETED).] 

(1) YES. (GO TO 3.b.) 

(2) NO, STILL ENROLLED. (GO TO E.4.) 

(3) NO, LEFT WITHOUT COMPLETING. (GO TO E.6.) 

b. When did you complete this program? 
month year 

How long [did it take (IF E.3.a = l)/will it take (IF E.3.a = 2)] you to complete this 
program? 

[NOTE TO INTERVIEWER: DO NOT ENTER DECIMAL VALUES; ROUND UP OR 
CONVERT TO A LOWER UNIT. FOR EXAMPLE, 1.5 YEARS WOULD BE ENTERED 
AS 18 MONTHS AND 6.5 HOURS WOULD BE ENTERED AS 7 HOURS.] 

a. [ENTER NUMBER 

b. THEN SPECIFY WHETHER THAT NUMBER IS IN: 

(1) DAYS 

(2) WEEKS 

(3) MONTHS 

(4) YEARS 

[Did you (IF E.3.a = 1/will you(IF E.3.a = 2)] earn continuing Education Credits (CEUs) for 
this program? 

(1) YES. 

(2) NO. 

a. Was this training for some type of work? 
(n YES. (G0T0E.6.b.) 
(2) NO. (GOTOE.7.) 



b. What type of work was this? 



Was taking this training a requirement for employment? 

(1) YES. 

(2) NO. 



B-31 

15{) 



REPEAT E.3 THROUGH E.7 FOR ANY ADDITIONAL PROGRAMS/COURSES UNDER 
CURRENT CATEGORY. 

[NOTE: LIMIT SEGMENTS OF E.3-E.7 TO ONLY 10 TOTAL. EACH SEGMENT SHOULD 
CARRY IDENTIFIERS OF: (a) THE TYPE OF PROGRAM (a-j, IN E.l), AND (B) A 
SEQUENTIAL NUMBER WITHIN A GIVEN PROGRAM.] 



F. Demographic Information (TIME STAMP ON START PAGE FOR SECTION F) 
The next few general questions are about you and your living arrangements. 

1. a. Did you live alone or with others during the first week of FEBRUARY, 1991? 

(1) ALONE. (GOTO F.2.) 

(2) WITH OTHERS (GO TO Lb.) 

b. With which of the following individuals did you live during that time? Please include 
everyone who lived in the household with you. (READ CHOICES AND RECORD 



"YES" 


OR "NO" TO EACH) 


(1) 


FATHER. (IF "YES", FILL IN F.l.b.2 AS "NO" AND GO TO F.l.b.3.) 


(2) 


OTHER MALE GUARDIAN. 


(3) 


MOTHER. (IF "YES", FILL IN F.Lb.4 AS "NO" AND GO TO F.Lb.5.) 


(4) 


OTHER FEMALE GUARDIAN. 


(5) 


BROTHERS OR SISTERS. 


(6) 


GRANDPARENTS. 


(7) 


HUSBAND OR WIFE. 


(8) 


YOUR OWN CHILDREN. 


(9) 


OTHER RELATIVES. 


(10) 


OTHER, NON-FAMILY, FRIENDS. 



F1B5_N. (IF F1B5 = YES) How many brothers and sisters were living with you? 



F1B6 N. (IF F1B6 = YES) How many grandparents were living with you? 



F1B8_N. (IF F1B8 = YES) How many of your children were living with you? 



F1B9_N. (IF F1B9 == YES) How many "^other relatives" were living with you? 



F1B10_^N. (IF FIBIO == YES) How many "other non-family, friends" were living with you? 



Where did you live in the first week of February 1991? (READ CHOICES AS 
NECESSARY) 

(1) IN SCHOOL-PROVIDED HOUSING, 

(2) IN SORORITY/FRATERNITY HOUSE. 

(3) IN OWN APARTMENT OR HOUSE (NOT WITH PARENTS), 

(4) WITH PARENTS OR GUARDIAN. 

(5) WITH RELATIVES, OTHER THAN PARENTS, SPOUSE, OR CHILDREN, 

(6) OTHER SITE, (SPECIFY) 

a. As of the first week of February 1991, what was your marital status? 

(1) Single, never married? (Go to F.5.) 

(2) Single, but living as married? (Go to F.4.) 

(3) Married? (Go to 3. b.) 

(4) Separated? (Go to 3.b.) 

(5) Divorced? (Go to 3.b.) 

(6) Widowed? (Go to 3, b,) 

b. When did [this (IF F3.a=3)/your previous (IF F.3,a>3)] marriage begin? 
month year 

(IF RESPONSE TO 3. a WAS (3), SKIP TO F.4) 

c. When did you stop living with your spouse? 
(G0T0F.5) 

month year 

Which of the follov/ing was your [spouse (IF F.3.a=3)/partner (IF F,3.a=2)] doing the first 
week of February 1991: (1) YES (2) NO 

a. Working for pay at a fiill-time job. (IF "YES", FILL IN 4.b-e AS "NO" AND GO 
TO 4.f.) 

b. Working for pay at a part-time job. (IF "YES", FILL IN 4.c-e AS "NO" AND GO 
TO 4.f.) 

c. Holding a job, but on temporary layoff from work, or waiting to report to work. (IF 
"YES", FILL IN 4.d-e AS "NO" AND GO TO 4.f.) 

d. Unemployed, lookijig for work. (IF "YES", FILL IN 4.e AS "NO" AND GO TO 
4.f.) 

e. Keeping house, with no outside job for pay. 

f. Taking courses at a graduate or professional school (such as law, medicine, dentistry). 
(IF "YES", FILL IN 4,g-i AS "NO" AND GO TO 4.j.) 

g. Taking academic courses at a two- or four-year college. (IF "YES", FILL IN 4.h-i 
AS "NO" AND GOTO 4.j.) 

h. Taking vocational or technical courses at any kind of school or college. (IF "YES", 
FILL IN 4.i AS "NO" AND GO TO 4.j.) 

i. Taking a break from school. 

j. Serving on active duty in the Armed Services, Reserves, or National Guard. (IF 

"YES". FILL IN 4.k AS "NO" AND GO TO 4.1.) 
k. Serving in an apprenticeship program or government job training program, 
1. Other (SPECIFY) 



B-33 

1^8 



5. a. As of the first week in February, 1991, did you have any children (including adopted 
and stepchildren)? 

(1) YES. 

(2) NO. (G0T0F.6.) 

b. How niany children did you have? 

c. When was your [first (IF F.S.b > 1)] child born? 
month year 

(IF [F.S.b] = 1, GO TO F,6; OTHERWISE, ASK F.S.d) 

d. When was your last child bom? 

month year 

5, a. Do you have any functional limitations, disabiiHids, or handicaps? (IF NEEDED, 
USE CATEGORIES IN F.6.b AS PROMPTS) 

(1) YES. (G0T0 6.b.) 

(2) NO. (GO TO SECTION G.) 

b. What functional limitations or disabiliti'-iS c:. yon have? (READ CHOICES AND 
RECORD "YES" OR "NO" TO EACH) 

(1) HEARING IMPAIRED. 

(2) SPEECH DISABILITY OR LlAtK ATION. 

(3) ORTHOPEDIC LIMITATION . 

(4) LEARNING DISABILITY. 

(5) VISUAL IMPAIRMENT NGT CORRECTABLE WITH GLASSES, OR 
LEGALLY BLIND. 

(6) OTHER HEALTH RELATED LIMITATION/DISABILITY. 

(7) ANY OTHER DISABILITY . (SPECIFY) 



G. Familv Information (TIME STAMP ON SECTION G START SCREEN) 
The next few questions are about your family and financial planning. 

(IF RESPONSE TO ITEM F.3.a WAS NEITHER (2) NOR (3), SKIP TO QUESTION G.8; 
OTHERWISE START WITH QUESTION G.l) 

I You indicated previously that you were [(married(IF F.3.a=3)/Iiving as married (F.3.a=2)]. 

(IF F.4.a OR F.4.h OR F.4.J WAS YES, CONTINUE WITH O. i.a'. OTHERWISE GO TO 
G.6) 

a. You also told us that your [spouse (IF F.3.a=3)/partner(iF F.3.a = 2)] was working 
the first week of February this year. What kind of v^ork was your [spouse (IF 
F.3.a = 3)/partner (IF F.3.a = 2)] doing (for example, registered nurse, personnel 
manager, salesperson, waitress, gasoline engine assembler, or MOS if in military)? 
[IF SPOUSE/PARTNER HAS MORE THAN ONE JOB, ASK ABOUT MAIN JOB] 
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(Fill in; PROBE FOR FULLY DESCRIPTIVE INFORMATION) 



What were your [spouse's (IF F.3.a = 3)/partner*s (IF F.3.a = 2)] most important 
duties (for example; patient care, directing hiring practices, supervising order clerks, 
assembling engines, operating grinding mill)? 



(Fill in: PROBE FOR FULLY DESCRIPTIVE INFORMATION) 

What type of company/organization was this?: (READ CHOICES AS 
NECESSARY.) 

(1) PRIVATE FOR-PROFIT? 

(2) PRIVATE NOT-FOR-PROFIT OR NON-PROFIT? 

(3) FEDERAL G O VERNMENT? 

(4) STATE GOVERNMENT? 

(5) LOCAL GOVERNMENT? 

(6) SELF EMPLOYED IN OWN BUSINESS, PROFESSIONAL PRACTICE, 
OR FARM (NOT INCORPORATED)? 

(7) SELF EMPLOYED IN OWN BUSINESS, PROFESSIONAL PRACTICE, 
OR FARM (INCORPORATED)? 

(8) OTHER. (SPECIFY). 

How many hours per week did your (spouse (IF F.3.a=3)/partner (IF F.3.a==2)] 
usually work? 

HOURS, PER WEEK; 

How many weeks per year did your [spouse (IF F.3.a=3)/partner (IF F.3.a == 2) 
usually work? 

WEEKS PER YEAR 



Was your (spouse^s (IF F.3.a=3)/partner's (IF F.3.a=2)] job a seasonal or a full- 
year job? 

(1) SEASONAL (GO TO 3.b.) 

(2) FULL YEAR (GO TO G.4.) 

When did this seasonal job normally start and end? 

START: , END: 

month month 
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4. 



a. 



What was your [spouse's (IF F.3.a=3)/partner's (IF F.3.a=2)] salary (before taxes 
and including tips and commissions) as of the first week of February 1991? 



(ENTER SALARY; ALLOW FOR TWO DECIMAL PLACES) 

Was this: (READ CHOICES AS NECESSARY) 

(1) HOURLY? 

(2) DAILY? 

(3) WEEKLY? 

(4) BIWEEKLY? 

(5) MONTHLY? 

(6) YEARLY? 

(7) OTHER (E.G., PER SEASON)? (SPECIFY) 



5. a. Is your [spouse (IF F.3.a=3)/partner (IF F.3.a=2)] still employed in this job? 

(1) YES. (GOTOG.60 

(2) NO. (GOTOS.b.) 

b. When did your [spouse (IF F.3.a=3)/partner (IF F.3.a=2)] leave this job? 
month year 

c. Is your [spouse (IF F.3.a=3)/partner (IF F.3.a=2)] currently employed in another 
job? 

(1) YES. 

(2) NO. 

6. What is your [spouse's (IF F.3.a=3)/partner's (IF F.3.a==2)] current level of education? 
(READ CHOICES AS NECESSARY) 

HIGH SCHOOL ONLY 

(1) Did not complete high school. 

(2) Completed high school or equivalent. 

VOCATIONAL 

(3) LESS THAN 1 YEAR OF OCCUPATIONAL, TRADE, TECHNICAL, OR 
BUSINESS SCHOOL. 

(4) 1 BUT LESS THAN 2 YEARS OF OCCUPATIONAL, TRADE, TECHNICAL, OR 
BUSINESS SCHOOL. 

(5) 2 YEARS OR MORE OF OCCUPATIONAL, TRADE, TECHNICAL, OR 
BUSINESS SCHOOL. 

ACADEMIC 

(6) LESS THAN 2 YEARS OF COLLEGE. 

(7) 2 OR MORE YEARS OF COLLEGE (INCLUDING 2-YEAR DEGREE). 

(8) COMPLETE BACCALAUREATE DEGREE (4 OR 5 YEAR DEGREE). 

(9) MASTER'S DEGREE OR EQUIVALENT. 

(10) Ph.D., M.D., OR OTHER ADVANCED PROFESSIONAL DEGREE. 
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7. (IF F.4.f OR F.4.g OR F.4.h IS "YES", ASK THIS QUESTION; OTHERWISE GO TO G.8) 
You told us earlier that your [spouse (IF F.3.a=3)/partner (IF F.3.a=2)] was enrolled in 
postsecondary education during the first week of February of this year. At what level was 
your [spouse (IF F.3.a=3)/partner (IF F.3.a=2)] enrolled? (READ CHOICES AS 
NECESSARY) 

(1) FIR T-YEAR OR FRESHMAN 

(2) SECOND YEAR OR SOPHOMORE 

(3) THIRD YEAR OR JUNIOR. 

(4) SENIOR. 

(5) SPECIAL STUDENT (NONMATRICULATED). 

(6) GRADUATE OR PROFESSIONAL (E.G. . LAW, MEDICINE, DENTISTRY) 
STUDENT. 

(7) OTHER (SPECIFY). 



8. a. What is your total expected income for 1991? This includes income from all sources 

such as wages and salaries, income from business or farm, Social Security, pension, 
dividends, interest, rent, and other income. $ [999999.97 = NONE] 

b. What was your total income for 1990? $ [999999.97 = NiJNEJ 

c. \,hat was your total income for 1989? $ [999999.97 NONE] 

9. (IF F.3.a RESPONSE IS 2 OR 3, ASK THIS QUESTION; OTHERWISE GO TO G.IO) 

a. What is your [spouse's (IF F.3.a=3)/partner*s (IF F.3.a=2)] total expeclwl income 
for 1991? This includes income from all sources such as wages and salaries, income 
from business or farm, Social Security, pensions, dividends, interest, rent, and any 
other income. $ [999999.97 = NONE] 

b. What was your [spouse's (IF F.3.a = 3)/partner\s (IF F.3.a=2)] total income for 
1990? $ [999999.97 = NONE] 



c. What was your [spouse's (IF F.3.a=:3)/partner\s (IF F.3.a=2)] total income to: 
1989? $ [999999.97 = NONE] 

10. a. During 1991, will your principal household (that is, where you will live for most of 

the year) include any adults, other than you ["and your spouse or partner" (IF 
F.3.a=:2 OR 3)) who will contribute to the household income? (Do not include 
sorority/fraternity sisters/brothers, college roommates, or other friends who will live 
with you.) 

(1) YES. (GO TO 10. b.) 

(2) NO. (GO TOG. 11.) 

b. What is the total expected household yeariy income for 1991? This inclurles income 
from all sources such as wages and salaries, income from business or farm, Social 
Security, pensions, dividends, interest, rent, and other income. $ . 
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a During 1990, did your principal household include any adults, other than you ("and 

your spouse or partner," IF F.3.a - 2 OR 3) who contributed to the household 
income? (Do not include sorority/fraternity sisters/brothers, college roommates, or 
other friends living with you at that time.) 

(1) YES. (GOTO ll.b.) 

(2) NO. (GO TOG. 12.) 

b, What was the total household yeariy income for 1990? This includes income from all 
sources such as wages and salaries, income from business or farm. Social Security, 
pensions, dividends, interest, rent, and other income. $ • 

a. During 1989, did your principal household include any adults, other than you ("and 
your spouse or partner," IF F.3.a = 2 OR 3) who contributed to the household 
income? (Do not include sorority/fraternity sisters /brothers, college roommates, or 
other friends living with you at that time.) 

(1) YES. (GOTO 12.b.) 

(2) NO. (GO TOG. 13.) 

b. What was the total household yeariy income for 1989? This includes income from all 
sources such as wages and salaries, income from business or farm, Social Security, 
pensions, dividends, interest, rent, and other income. $ . 

a. Do you [and/or your spouse (IF F.3.a=3)/and/or your partner (IF F.3.a=2)l 
regularly put money into a savings account, savings bonds, retirement account, or 
other form of savings? 

(1) YES. (GOTO 13.b.) 

(2) NO. (GO TOG. 14.) 

b. How often do you [and/or your spouse (IF F.3.a^3)/and/or your partner (IF 
F.3.a=2)] put money into savings? (READ CHOICES AS NECESSARY) 

(1) WEEKLY. 

(2) MONTHLY. 

(3) EVERY 2 OR 3 MONTHS. 

(4) LESS OFTEN THAN EVERY 3 MONTHS BUT MORE OFTEN THAN 
ONCE A YEAR. 

(5) ONCE A YEAR. 

(6) LESS OFTEN THAN ONCE A YEAR. 

Do you (and/or your spouse (IF F.3.a=3)/and/or your partner (IF F.3.a = 2)l own: 
(1) YES, (2) NO. 

a. Your primary residence. 

b. Another residence. 

c. A car or truck. 

d. Investments such as stocks, bonds, rental property. 

e. A farm or business. 

f. Other major items such as an RV, boat. 

g. [IF G. 14. c = YES) How many cars or trucks do you own? 



For how many individuals, other than yourself, but including family members and other 
persons, do you have financial responsibility? INDIVIDUALS. 
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16. 



For how many individuals, such as a child or an elderly person (excluding yourself but 
including family members .Jid other persons), do you have caretaker or other time- 
commitment responsibilities? INDIVIDUALS. 



Goals, Aspirations. Expectations (Including Plans for Graduate School) 

Now, we would like to ask you some questions about your aspirations, goals and expectations in the 
areas of education and work. 

(TIME STAMP ON START SECTION H SCREEN) 

1. What is the highest level of education you would like to complete (that is, if you were able 
continue as long as you would care to)? (READ CHOICES AS NECESSARY) 

VOCATIONAL : 

(1) LESS THAN 1 YEAR OF OCCUPATIONAL. TRADE, TECHNICAL, OR 
BUSINESS SCHOOL. 

(2) ONE BUT LESS THAN 2 YEARS OF OCCUPATIONAL, TRyVDE, TECHNICAL. 
OR BUSINESS SCHOOL. 

(3) TWO YEARS OR MORE OF OCCUPATIONAL, TRADE, TECHNICAL, OR 
BUSINESS SCHOOL. 

ACADEMIC : 

(4) LESS THAN 2 YEARS OF COLLEGE, 

(5) TWO OR MORE YEARS OF COLLEGE (INCLUDING 2-YHAR DEGREE). 

(6) BACCALAUREATE DEGREE (4 OR 5 YEAR DEGREE). 

(7) MASTER'S DEGREE OR EQUIVALENT. 

(8) Ph.D., M.D., OR OTHER ADVANCED PROFESSIONAL DEGREE. 

2. Considering all practical constraints, what is the h'ghcst level of education you cvt-r expect \n 
complete? (READ CHOICES AS NECESS/^RY) 

VOCATIONAL : 

(1) LESS THAN 1 YEAR OF OCCUPATIONAL, TRADE, TECHNICAL, OR 
BUSINESS SCHOOL. 

(2) ONE BUT LESS THAN 2 YEARS OF OCCUPATIONAL, TRADE, TECHNICAL. 
OR BUSINESS SCHOOL. 

(3) TWO YEARS OR MORE OF OCCUPATIONAL. TRADE, TECHNICAL, OR 
BUSINESS SCHOOL. 

ACADEMIC : 

(4) LESS THAN 2 YEARS OF COLLEGE. 

(5) TWO OR MORE YEARS OF COLLEGE (INCLUDING 2-YnAR DEGREE). 

(6) BACCALAUREATE DEGREE (4 OR t> YEAR DEGREE). 

(7) ^^ASTER^S DEGREE OR EQUIVALENT. 

(8) Ph.D., M.D., OR OTHER ADVANCED PROFESSIONAL DEGREE. 

3. (IF EXPECTS TO ATFEND GRADUATE SCHOOf,; I.E.. RFSPONSl- TO H.2 WAS 7 OR 
8, ASK THIS QUESTI0N;OTHERWISE SKIP TO H.IO) 
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a. Have you applied or do you intend to apply for graduate school? 
fl) YES. HAVE APPI lED. (GOTO H.3.b) 

(2) YES. INTEND TO APPLY. (GO TO H.3.b.) 

(3) NO. (GO TO H.IO.) 

b. To how miuiy graduate schcxjl.s, in total, have you or do you intend to apply? 



(Numlier ot schools) 

4. When [did you (IF H.3.a. = l)/will you (IF H.3.a - 2}] first apply? 
month year 

5. When do you expect to enter j:raduate sch<Mil? 

month year 

0. For what iield(s) {}{ study did you or will y(ju apply? 

a. 

b. 

c. _ 

7. a. What is your first choice institution where you have applied or will apply? 
institution name: 



City (Post Olfice): 

[NOTE TO INTERVIEWERS; CHECK WITH RESPONDENT IF NEEDliD fO W. SURE 
OF SPELLING OF CITY. USE NO PUNCTUATION MARKS IN CITY NAME AND DO 
NOT ABBREVIATE : SEE SPECIAL INSTRUCTIONS. ALSO. PROBE RESPONDENT 
FOR CORRECT SCHOOL NAME; SOME WILL GIVE A SCHOOL WITH IN A 
UNIVERSITY RATHER THAN THE UNIVERSITY (E.G.. \ UQVA SCHOOL OF 
BUSINESS INSTEAD OF DUKE UNIVERSITY.)! 

[USER EXIT AND SCREENS FOR VERIFICATION OF IPEDS CODE GO HERE] 
IPEDS CODE FILL IN 

b. What spcviFic pio^'iani or Held o*' study did you (ir wdl \nu appK ior at thi-^ 

institution? 



c. Did you or will you apply for financial aid, including any kind of a^sistantship, at this 
institution? 

(1) YES. 

(2) NO. 
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(ASK THIS Ql^iESTION ONLY IF H.3.b > 1) 

a. What was your second choice institution where you have applied or will apply? 



Institution name: 

City (Post Office): State: 



[NOTE TO INTERVIEWERS: CHECK WTFH RESPONDEMT IF NEEDED TO BB SURE 
OF SPELLING OF CITY. USE NO PUNCTUATION MARKS IN CITY NAME AND DO 
NOT A BBREVIATE : SEE SPECIAL INSTRUCTIONS. ALSO. PROHF RESPONDENT 
FOR CORRECT SCHOOL NAME; SOME WILL GIVE A SCHOOL WITHIN A 
UNIVERSITY RATHER THAN THE UNIVERSITY (E.G.. FUQUA SCHOOL OF 
BUSINESS INSTEAD OF DUKE UNIVERSITY.)) 



[USER EXIT AND SCKEHNS FOR Vi:kIl-ICATION OF IPhDS ('()])[{ (K) HliRL] 
IPEDS CODE FILL IN 



b. What spa iHc pn^^^rain or fK-lcl of study did you or will you apply for at thi«» 
institution? 



c, Did you or will y(ni apply t(»r financial aid, includuig any kind of assistantship, at this 

in*;tituli{)n? 

(1) YES. 

(2) NO. 

a. Have you taken or do you plan to take an admissions or professional test, f^k h a • the 
ORE (Graduate Records Exanunation), Uiw ScIumjI Adinissioiis Test, or Medical 
Collej^re Adnii^^ions Te«.t? 

i\) YE.S. (GO TO 9. k) 
(2) NO. (GOTO H. 10.) 

b. Which ol the following professional or adniii.sions tests have you taken or plan to 
take'.' (I) HAVE TAKEN (2) PLAN TO TAKE (3) DO NOT PLAN TO TAKE 

(a) Graduate Record Exam (ORE)? 

(b) Miller's Analo^^ Test? 

(e) Dental Admission Test (DAT)? 

(d) Graduate Management Admissions Test (GMAT cm' ATGSU).' 

(e) Law SehiK'l Adniissions Te^l (LSAT)'/ 

(0 Medical Culle^a^ Adnussions Te t (MCA 1 ;/ 

(i!) Other.' (SPECIFY) 
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The next few ([uestions concern your education plans one. two. five and ten years from now. 
If you'ff not Mire, please yive »<! ymjr best estinutes. One year fronn now (Spring 1992) \mi1 
ycu be 

(READ CHOICES) 

(1) ENROLLED IN THE SAME PROGRAM IN WHICH CURRENTLY (OR LAST) 
ENROLLED. 

(2) ENROLLED IN A DIFFERENT PROGRAM AT THE UNDERGRADUATE 
LEVEL. 

(3j ENROLLED IN A MASTER'S, DOCTORAL, OR PROFESSIONAL PROGRAM 

(E.G.. MD, DD, LLB). 
(4) NOT ENROLLED AT ANY LEVEL. 

Two years from now (Spiing 1993) will you be 
(READ CHOICES) 

(1) ENROLLED IN THE SAME PRfXiRAM IN WHICH CURRENTLY (OR LAST) 
ENROLLED. 

(2) ENROLLED IN A DIFFERENT PROGRAM AT Till-: UNUl-KCJRADUA TU 
LEVEL. 

ENROLLED IN A MASTER'S. DOCTORAL. OR PROFESSIONAL PkOtJRAM 
(F-,.G.. MD, DD, LLB). 
(4) NOT ENROLLED AT ANY LEVEL. 

Fivf. years lioni now (Spring 1996) will you h- 
(READ CHOICES) 

(1) ENROLLED IN THE SAME PRCX'.RAM IN WHICH (niRRENTLY (OR I ASI) 
ENROLLED. 

(2) ENROI.LI-D IN A DIFFERENT PR(XjRAM AT THE UNDERC5RADUATE 
LEVEL. 

(.1) ENROLLED IN A MASTER'S, DOCTORAL. OR PROFESSIONAL PROGRAM 

(E.G., MD. DD. LLU). 
(4) NOT ENROLLED AT ANY LEVEL. 

Ten year."; from now (Spring 2001) will vtui In- (READ CHOICES) 

(1) ENROLLED IN THE SAME PRCKJRAM IN WHICH CURRENTLY (OR LAST) 
ENROLLED. 

(2) ENROLLED IN A DIFFERENT PRCXJRAM AT IHE UNDERGRADUATE 
LEVEL. 

(3) ENROLLED IN A MASTER'S, DOCTORAL. OR PROFESSIONAL PROCJRAM 
(E.G.. MD. DD, LLB). 

(4) NO r ENROLLED AT ANY LFA'EL. 

The next few quclinns concern vour emp loy nun! plinis foi i-n ■. lu... tne, nnJ ton ycar^; from 
now. If you're not .'^ure. please give us your he^^t i-^Jmiales, 

a. One year from now (Spring, 1992). do you intend to he workmg either lull tunc or 
part time? 

(1) YES, FULL TIME. (GO TO 11. 14. b.) 

(2) YES. PART TIME. (G( ) TO H. I4.b) 
(.1) NO. (GOTO H. 13) 
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b. What type of joh or occupation (for example, salesperson, waitre5:5>, assembler} do 
you pUn lo Uns'v 1 yt^r friim now? If yow'rr noC sure, plrjisr provide your hrM 
estimate. 

(RESPONSE TO BE CODED INTO STANDARD OCCUPATION CODE.) 



c. Would this job be related to ^our current (or most recent) educational program? 
(IJ YES. 

(2) NO. 

d. How much do you expect your annual salary to \k ul that time In^fore taxe^? (Rf'AD 
CHOICES AS NECESSARY. PARTICULARLY IF RESPONDENT SEEMS 
RHLUCTANT TO GIVE A SPECIFIC AMOUNT. IF RESPONDENT ASKS. 
INDICATE THAT AMOUNTS SHOULD BE -CURRENT"-!. E., AT THAT TIME- 
-DOLLARS.) 

(1) LESS THAN $12,000. 

l2) AT i,LAST $12.CMJ liU'l' LESS THAN $24,l»00. 

(3) AT LEAST $24,000 BUT LESS THAN $30.fX)(). 

(4) AT LEAST $30,CXK) BUT LESS THAN .$50,fKX). 

(5) AT LEAST $50,000 BUT LESS THAN $73,0C>0. 

(6) AT LEAST $75,(X)0 BUT LESS THAN $100,000. 

(7) $100,000 OR MORE. 



15. a. Twn_yctirs from now (Spring. 1903), do you intend to he working cither full timt* or 

part time? 

(1) YES, FULL TIMH. ((K)TOI5.b.) 

(2) YES, PART TIMh. f(iO 10 l^.b.) 

(3) NO. (GO TO H.I6.) 

b. (IF RESPONSE TO H.14.a WAS "NO- OR INDETERMINATE. GO TO iLi5.e; 

OTHL'RWISE, ASK H.lS.b) Would you expect be employed in the '^iu.e job you 
|U^l told us al-KHit/ 

'(I) YFS. (CATI PROGRAM FILLS IN 15.^. WITH RESPONSE TO 14. b. 

AND FILLS IN IS.d WITH RESPONSE TO 14.c A ND GO TO 15. c.) 
(2) NO. (GO TO 15.e.) 

L. What type (»f )ob or (Kcupation (for t"^amplL\ .alf jh t "ri, uaitrcss. i's jmbKr) iln 

ViUi plan lO hiivc 2 years from now? II you're not sure, please provide unn bc^t 
estimate. 

(RESPONSE TO BE CODED INTO STANDARD OCCUPATION CODE.) 



d. Would this job K- related to your current (or mo>t recent) i durational pf'.>'iram.* 

(1) YES. 

(2) NO. 
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How much do you expect your annual salary to be, at that time, before taxes? 
(READ CHOICES AS NECHSSARY, PARTICULARLY IF RESPONDENT SEEMS 
RELUCTANT TO GIVE A SPECIFIC AMOUNT. IF RESPONDENT ASKS, 
INDICATE THAT AMOUNTS SHOULD BE IN "CURRENT^-I.E., AT THAT 
TIME-DOLLARS,) 

(1) LESS THAN $12,000. 

(2) AT LEAST $12,000 BUT LESS THAN $24,000. 

(3) AT LEAST $24,000 BUT LESS THAN $30,000. 

(4) AT LEAST $30,000 BUT LESS THAN $50,000. 

(5) AT LEAST $50,000 BUT LESS THAN $75,000. 

(6) AT LEAST $75,000 BUT LESS THAN $100,000. 

(7) $100,000 OR MORE. 

Five yc-ars from now (Fehniary, 1996), do you intend to be working either full time 
or part lime? 

(1) YES, FULLTIME (GOTO 16. b.) 

(2) YES, PART TIME (GO TO 16.h) 

(3) NO. (GOTO H.17.) 

(IF RESPONSE TO H. 15,a WAS "NO" OR INDETERMINATE, GO TO H.16.c; 
OTHfRWISE, ASK H. 16. b) Would you expect to he employed in the same job you 
just told us about? 

(1) YES. (CATI PROGRAM FILLS IN 16. c WFI H RESPONSE TO 15. c AND 
FILLS IN 16.d WITH RESPONSE TO 15. d AND GO TO 16. c.) 

(2) NO. (GOTO 10. c) 

What type of job or occupation (ft»r example, salesperson, waitress, ass^jmhlur) do 
you plan to have 5 years from now? If you're not sure, ple^ise provide your Ixist 
estinutte. 

(RESPONSE TO BE CODED INTO STANDARD OCCUPATION CODE.) 



Would this job be related to your current (or most recent) educational program? 

(1) YES. 

(2) NO. 

How much do you expe(.t your annual Siilary to be, at that time, before taxes? 
(READ CHOICES / i NECHSSARY, PARTICULARLY IF RESPONDENT SEEMS 
RELUCTANT TO GIVE A SPECIFIC AMOUNT. IF RESPONDENT ASKS. 
INDICATE THAT AMOUNTS SHOULD BE IN "CURRENT-^-I.E., AT THAT 
TIME- DOLLARS.) 
(Ij LESS THAN $12,fKX). 

(2) AT LEAST $12,000 BUT LESS THAN $24,000. 

(3) AT LEAST $24,000 BUT LESS THAN $30,000. 

(4) AT LEAST $30,000 BUT LESS THAN $50,000. 

(5) AT LEAST $50,000 BUT LESS THAN $75,000. 

(6) .-^T LEAST $75,000 BUT LESS THAN $1(K).(XK:). 

(7) $100,000 OR MORE. 



a. Ten years from now (Spring, 2001), do you intend to be working either full time or 
part time? 

(1) YHS. FULLTIME. (GO TO 17. h.) 

(2) YES, PART TIME. (GOTO 17.b.) 

(3) NO. (GOTO H. 18.) 

b. (IF RESPONSE TO H.16.a WAS "NO" OR INDETERMINATE. GO TO 17. c; 
OTHERWISE ASK H.17.b) Would you expect to be employed in the same job you 
just told us about? 

d) YES. (CATI PROGRAM FILLS IN 17.c WITH RESPONSE TO 16.c AND 

FILLS IN 17. d WITH RESPONSE TO 16.d AND GO TO I7.e) 
(2) NO. (GO TO 17.C) 

c. What type of Job or occupation (for example, .salesperson, waitress, assembler) do 
you plan to have 10 years from now? If you're not sure, please provide your best 
estimate. 

(RESPONSE TO BE CODED INTO STANDARD OCCUPATION CODE.) 



d. Would this job be related to your current (or most recent) educational program? 

(1) YES. 

(2) NO. 

e. How much do you expect your annual salary t j be, at that time, t>efore taxes? 
(READ CHOICES AS NECESSARY. PARTICULARLY IF RESPONDENT SEEM 
RELUCTANT TO GIVE A SPECIFIC AMOUNT. IF RESPONDENT ASKS. 
INDICATE THAT AMOUNT SHOULD BE IN "CURRENr-I.E., AT THAT 
TIME-DOLLARS.) 

(1) LESS THAN $12,000. 

(2) AT LEAST $12,000 BUT LESS THAN $24,000. 

(3) AT LEAST $24,000 BUT LESS THAN $30,000. 

(4) AT LEAST $30,0(X) BUT LESS THAN $50,000. 

(5) AT LEAST $50,000 BUT LESS THAN $75,000. 

(6) AT LEAST $75,000 BUT LESS THAN $100,000. 

(7) $100,000 OR MORE. 

(ASK ONLY IF STILL ENROLLLD IN SCHOOL:) H you went mto the workforce 
immediately alter cdmplcting the proirram in which you are now enrolled, how much wcuild 
y(ni expect your first year annual salary to be, K fure taxes? (READ CHOICES AS 
NECESSARY, PARTICULARLY IF RESPONDENT SEEMS RELUCT .NT TO GIVE A 
SPECIFIC AMOUNT. IF RESPONDENT ASKS, INDICATE THAT AMOUNT SHOULD 
BE IN X^JRKEN f-I.E.. AT THAT TIME-DOLI ARS.} 

1 - LESS THAN $12,000. 

2 - AT LEAST $12,000 BUT LESS THAN $24,000. 

3 - AT LEAST $24,000 BUT LEi S THAN S30,CKX). 

4 AT LEAST $30,000 BUT LESS THAN $:^0.0OC. 

5 " AT LEAST S50,000 BUT LESS THAN $75,01^0. 
0 - AT LEAST $75,000 BUT LESS THAN $100.CK}0. 
7 - $ 100,000 UR MORE. 
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19. How important is each of the following factors in determining the kind of work you plan to he 
doing for most of your life? Please rate each as: (1) not important, (2) somewhat important, 
or (3) very im|X)rtant. (CATl PROGRAM CREATES A RANDOM STARTING POINT 
BETWEEN a AND k. STORES THAT START POINT AS HRANDl , AND PRESENTS 
ALL RESPONSE CATEGORIES, IN ORDER FROM THAT POINT, WRAPPING AS 
NECESSARY.) 

a. Previous work experience in the area. 

b. Good income to start or within a few years. 

c. Job security and permanence. 

d. Work that seems important and interesting to you. 

e. Freedom to make your own decisions. 

f. Meeting and working with sociable people. 

g. Having a job that has high status and pre<;tige, 

h. Having a job where most problems are quite difficult and challenging. 

i. Having a job that allows you to establish roots in a community and not have to move 
from place to place. 

j. Having a job that leaves a lo: of time for other things iu your life, 

k. Having a job that allows a great deal of travel. 



Public Service and Votink! Hxperu-nce (TIME STAMP ON START SECTION I SCREEN) The next 
few questions are about your experience in public affairs and public service. 

L a. Are you or have you ever been registered to vote? 

(1) YES, CURRENTLY REGISTERED. (GOTO Lb.) 

(2) YES, BUT NOT CURRENTLY REGISTERED. (GO TO Lb) 

(3) NO, NEVER REGISTERED. (GOTO I.e.) 

(4) NO, NOT ELIGIBLE. (GO TO I.e.) 

b. Durmg the past two years (1989 and 1990), did you vote in any local or .state 
elections? 

(1) YES. 

(2) NO. 

c« Do you expect to vote in the 1992 pre.sidential election? 

(1) YUS. 

(2) NO. 

2. During the past two years (from the start of 1989 to present), have you performed volunteer or 

community service work (such as PTA, little le^igue, scouts, ser\'ice clubs, church grojps, 
social action groups)? 

(1) YES. (GOTO 1.3.) 

(2) NO. (GO TO L8.) 
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How long have you been involved in such activities? 

(months) [IF LESS THAN I MONTH ENTER 1; CONVERT YEAR RESPONSES TO 
MONTHS] 

Was any of this work: (I) YES (2) NO 

a. Strictly Voluntary? 

b, Court ordered? 

c, Required by one of your classes? 

d. Required for other reasons? (SPECIFY) 



What types of community organizations were you involved with in your volunteer or 
community seivice work? (READ CHOICiiS AND ENTER YES = I OR NO - 2 TO 



EACH.) 




a. 


A YOUTH ORGANIZATION, SUCH AS LITTLE LEAGUE OR SCOUTS. 


h. 


SERVICE ORGANIZATIONS, SUCH AS ROTARY OR JUNIOR CHAMBER OF 




COMMERCE. 


c. 


POLITICAL CLUBS OR ORGANIZATIONS. 


d. 


CHURCH OR CHURCH-RELATED GROUPS (NOT COUNTING WORSHIP 




SERVICES). 


e. 


COMMUNITY CENTERS, NEIGHBORHOOD IMPROVEMENT, OR SOCIAL- 




ACTION ASSOCIATIONS OR GROUPS. 


f. 


ORGANIZED VOLUNTEER GROUP IN A HOSPITAL OR NURSING HOME. 


S- 


EDUCATIONAL ORGANIZATIONS SUCH AS PTA. 


h. 


OTHER. (SPECIFY) 


Are you currently doing any volunteer or community service work? 


(1) 


YES. 


(2) 


NO. 



Approximately how many hours per week, on the average , [did yoi' yl? 1.6 4^ YES)/ do you 
perform community seivice work? HOURS PER WEEK. 

a. Do you expect to perform any volunteer or community work during the next two 
years? 

(1) YES. (GOTOS.b.) 

(2) NO. (GO TO 1.9.) 

b. Over the next two years, how many months do you expect to be involved in volunte 
or community service act ivi lies? 



months (NOTE: NOT TO EXCEED 24) 

Approximately how many hours per week, on the average, do you think you will 
perform community service work during the next two years? 



(hours per week — if less than 1 enter 1) 
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9. [IF PRISRV = U FILL IN 9.2 AS "YES", AND GO TO SECTION J; OTHERWISE ASK 
9.a] 

a. Have you ever been in the military service (including National Guard and reserves?) 

(1) YES. (GO TO SECTION J.) 

(2) NO. (G0T0 9.b.) 

b. What is the likelihood of future ser^'ice? 

(1) Definitely yes. 

(2) Probably. 

(3) Probably not. 

(4) Definitely not. 



J. Locator information (TIME STAMP ON SECTION J, START SCREEN) 

We will be getting in touch with you again in about two years to fmd out how your plans have worked 
out. These final questions are to help us fmd you. This information will be kept strictly confidential, 
as we explained earlier. 

1. (IF NO PRIOR DATA AVAILABLE, SKIP I. a AND GO DIREC':LY TO l.b.) 

a. You previously gave (name, address, and telephone number of pertinent person from 
existing record) as a person who would always know where to get in touch with you. 
Is this still correct? 

(1) YES. (G0T0J.2.) 

(2) NO. (CORRECT/COMPLETE EXISTING DATA AS APPROPRIATE, 
AND GO TO J.2.b) 

b. Please tell me the name, address, and telephone number of a person (preferably a 
relative other than your parents) who lives at an address different from yours , who 
v/ill always know where to get in touch with you. 



First Name MI Last Name 



Address 



City State Zip 

( ) 

Telephone Number 
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(IF NO PRIOR DATA, SKIP 2.a AND GO DIRECTLY TC» 2.b.) 



a. You told us that this person was (relationship from record). Is that correct? 

(1) YES. (GO TO J. 3.) 

(2) NO. (CORRECT/COMPLETE EXISTING DATA AS APPROPRIATE 
AND GO TO J.3.) 

b. What is (NAME OF CONTACT PE'RSON)'s relationship to you? 

(1) MOTHER/FEMALE GUARLTAN. 

(2) FATHER/MALE GUARDIAN. 

(3) SISTER/BROTHER. 

(4) SPOUSE OR FORMER SPOUSE 

(5) OTHER RELATIVE, INCLUDING IN-LAWS. 

(6) FRIEND. 

(7) OTHER. 

c. [IF J2b = 5] Specify relationship of "other relative, including in-laws" 



d. [IF J2b = 7] Specify type of "other". 



[IF "MOTHER/FEMALE GUARDIAN" LISTED IN J. 2. SKIP TO J.4. OTHER MSE GO 
TO J.3.a IF "MOTHER DECEASED CODE" = 1 OR TO J.3.b IF "MOTHER DECEASED 
CODE = 0] 

a. We understand that your mother (or female guardian) is either deceased, unknown to 
you, or not in sufficiently good health for us to contact her. Is that correct? 

(1) YES (FILL IN J.3.b = "NO" AND GO TO J.4)) 

(2) NO (FILL IN J.3.b = "YES" AND GO TO J.3.d) 

b. We would also like to [verify /obtain] information about your mother or female 
guardian; is she living and in sufficiently good health for us to contact her? 

(1) YES. (GO TO J.3.C IF NAME DATA AVAILABLE; GO TO J.3.d IF 
NOT) 

(2) NO. (GO TO J.4) 

c. Our reords show that your mother' s/female guardian's name is 
; is that correct? 

(1) YES. (GOTOJ.3.e) 

(2) NO. (CORRECT/COMPLETE EXISTING DATA AND GO TO J.3.u) 

d. What is your mother's/female guardian's name? 



First Name MI Last Name 
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e. (IF J. 2 IS "FATHER/MALE GUARDIAN" AND "FATHER DECEASED CODE" 
NOT EQUAL TO 1, THEN ASK THIS QUESTION; OTHERWISE GO TO J.3,f. IF 
MOTHER^S ADDRESS DATA EXISTS OR TO J.3.g. IF NOT) Is the addres.^ tor 
your mother/female guardian the same as that you just gave me for your father/male 
guardian? 

(1) YES. (CATI PROGRAM FILLS IN DATA FROM J.I; THEl. GO TO J. 5) 

(2) NO. (IF MOTHER'S/FEMALE GUARDIAN'S ADDRESS/PHONE 
NUMBER AVAILABLE FROM NPSAS:90, GO TO J.3.f; IF DATA NOT 
AVAILABLE, GO TO J.3.g) 

f. Our records show your mother's/female guardian's address and telephone number is 
(FROM PRELOADED DATA). Is this information still correct? 

(1) YES. (GO TO J. 4) 

(2) NO. (CORRECT/COMPLETE EXISTING DATA AND THEN GO TO J. 4) 

g. \Vliat is your mother's/female guardian^s address and telephone number 



Address 



City State Zip 

( ) 

Telephone Number 

[IF "FATHER/MALE GUARDIAN" LISTED IN J. 2 SKIP TO J. 5. OTHERWISE GO TO 
J. 4. a. IF "FATHER DECEASED CODE" = 1, OR TO J.4.b IF "FATHER DECEASED 
CODE" = 0| 

a. We understand that your father (or male guardian) is either dece^ised, unknown to 
yoi', or not in sufficiently good health for us to contact him. Is that correct? 

(1) YES (FILL IN J.4.b - "NO" AND GO TO J. 5) 

(2) NO (FILL IN J.4.b = "YES" AND GO TO J.4.d) 

b. We would also like to [vt'rify/obiain] information about your father or male guardian: 
is he living and in sufficiently good hwdth for us to contact him? 

(1) YES. (GO TO J.4.C IF NAME DATA AVAILABLE; GO TO J.4.d IF 
NOT) 

(2) NO. (GO TO J. 3) 

c. Our records show that your falher\s/niale guardian's n;i'ne is 
; i^ that correct? 

(1) yes" "(G0 TOJ.4.e) 

(2) NO. (CORRECT/COMPLETE EXISTING DATA AND GO TO J.4.e) 

d. What IS your father's/male guardian's name? 



First Name Ml Litst Name 
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i (IF J 2 IS 'MOTHER" OR "FEMALE GUARDIAN" OR IF J.3.b RESPONSE IS 

YES ASK THIS QUESTION; OTHERWISP. GO TO J.4.f IF FATHER'S 
ADDRESS IS AVAILABLE FROM NPSAS:90. OR GO TO J.4.g IF NOT) Is the 
address for your father/nialc guardian; the same as that you jusi gave us lor your 
mother/ female guardian? 

(1) YES (CATI PROGRAM FILLS IN DATA FROM J.i. (IF J.2 = 
MOTHER) OR FROM J.3.f or g (IF J.3.b IS "YES"); THEN GO TO J.5) 

(2) NO. (IF FATHER'S/MALE GUARDIAN'S ADDRESS/PHONE NUMb-^.R 
AVAILABLE FROM NPSAS:90, GO TO J.4.f; IF DATA NOT 
AVAILABLE. GO TO J.4.g) 

f. Our records show your father's/male guardian's address and telephone number is 
(FROM PRELOADED DATA). Is this information .still correct? 

(1) YES. (GO TO J.5) 

(2) NO. (CORRECT/COMPLETE EXISTING OATA AND THEN GO TO J.3) 

g. What is your father's/male guardian's address and telephone number 



Address 



City State Zip 

( ) 

Telephone Number 

(IF J 2 IS "SPOUSE", "MOTHER/FEMALE GUARDIAN" OR "FATHER/MALE 
GUARDIAN" ASK QUESTION 5.a; ELSE. IF J.3.b ="N0" AND J.4.b = "NO", THEN 
ASK 5.a; OTHERWISE SKIP TO J.6) 

a Would you give me the name, address, and telephone number of one other person 

(friend or relative) who Im-q m -.n ..l.ln^ss different from yours and will probably 
know where you will be in two years? 



First Name MI U.st Name 



Address 



City State Zip 

( ) 

Telephone Number 

VSHiat is (NAME OF CONTACT PBRSuN)'s relationship to you? 

(3) SISTER/BROTHER. 

(4) SPOUSE OR FORMER SPOUSE. 

(5) OTHER RELATIVE, INCLUDING IN-LAWS. 

(6) , FRIEND. 
(7, OTHER. 

[IF J5b = 51 Specify relationship of "other relative including in-laws" 
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[IF J5b = 7] Specify type of "other" 



Is your current address still (CURRENT ADDRESS FROM RECORD)? 

(1) YES. (G0T0J.6.C.) 

(2) NO. 

What is your current address? 
CURRENT ADDRESS 



Address 



City State Zip 

[IF NOT OBVIOUS, ASK-IF OBVIOUS FILL IN YES WITHOUT ASKING] Is 
the phone number you are speaking from the phone number at your current address? 

(1) YES. (CATI PROGRAM FILLS IN J.6.e WITH ACTIVE PHONE 
NUMBER AND GO TO J.6.0 

(2) NO. 

To whom does the telephone number from v.'hich you are speaking belong, (e.g., 
friend, work, school, parent)? 



(fill in response) 

What is your current home telephone number? 

( ) [(999) 999-9997 = NO CURRENT PHONE 

(telephone) NUMBER] 

Do you think it is Hkely that you will be at this address in two years? 

(1) YES. 

(2) NO. 

Is your current address also your permanent address? 

(1) YES. (GO TO J. 8 AND FILL IN PERMANENT ADDRESS WITH 

CURRENT ADDRESS) 

(2) NO. (GO TO J. 7) 

Do you have a permanent address and telephone number that is different from the 
ones you have gi\'en us so far? 

(1) YES. (G0T0J.7.C) 

(2) NO. (G0T0J.7.b) 

Which of the addresses you have provided is your permanent address? 

(1) Original contact person's. 

(2) Mother/female guardian. 

(3) Father/male guardian. 

(4) Current address. 

(5) NONE. Have no permanent address. 
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[GO TO J.8; ALSO, IF ANSWERED M to J.7.b, CATI PROGRAM FILLS IN 
PERMANENT ADDRFSS AND TELEPHONE NUMBER FROM APPROPRIATE PRIOR 
RESPONSE (J.l, J.3.f or g, J,4.f or g, OR J.6.a AND J.6.c.2.b] 

c. What is your permanent address and telephone number? 



Address 



City State Zip 

( ) 

Telephone Number 

a. Let me make sure we have your name spelled correctly. Your full name is 
(RESPONDENT'S FULL NAME); (INTERVIEWER SHOULD ALSO SPELL 
NAME). Is that correct? 

1 = CORRECT. (GO TO J.9.) 

2 = INCORRECT. (CONTINUE WITH J.8.b) 

b. What is your correct full name? 



First Name MI Last Name 

a. [IF MARRIED, DIVORCED, SEPARATED, OR WIDOWED] Did you have a 
different last name before you married? 

(1) YES. (GO TO J.9.b IF "PRIOR NAME" DATA AVAILABLE, IF NOT, 

GO TO J.9.C.)) 

(2) NO. (GO TO J. 10) 

b. You previously told us your name before you were married was (1 ILL IN), is that 
correct? 

(1) YES (GO TO J. 10) 

(2) NO (CORRECT/COMPLETE EXISTING DATA AS NEEDED AND 

GO TO LIO) 

c. What was your last name before you married? 



(Prior Name) 

(IF NPSAS:90 "OTHER NAME" DATA AVAILABLE ASK lO.a; IF BLANK ASK lO.b) 

a. You previously told us that you were also known by your friends, relatives, or 

neighbors as (FILL IN PRELOADED DATA) . Is there something else you are called 
now? 

(1) YES (CORRECT/COMPLETE EXISTING DATA AS NEEDED AND 

GOTOJ.ll) 

(2) NO, SAME NICKNAME (GO TO J. 1 1) 

(3) NO, NO NICKNAME (BLANK EXISTING D.^TA AND GO TO J. 1 1 ) 
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b. Do your friends, nei)^»hb<^rs, or relatives know you by any name other than your le^al 
namt ; for example, a nicknaiw/ 

(1) YES. (CONTINUE WITH J. lu.c) 

(2) NO. (GO TO J. i I) 

c. What other name arc you known by 7 

11. (ASK ONLY IF MARRIED AND NEITHER J. 2 NOR J.S.b IS SPOUSE:) 
a. What is the name of your sp43use7 



First Name MI Last Name 

12. (IF AVAILABLE PRIOR DATA ASK J. 12. a, IF NO DATA GO TO J.12.b.) 

a. In 1989, you told us your Social Security number was (SS number). Is llutl eorrevl? 

(1) YES. (GO TO J. 13.) 

(2) NO. (CORRECT/COMPLETE EXISTING DATA AND GO TO J. 13) 

b. What is your Social Security number? 
[999999997 - NO SOCIAL SECURITY NUMBER) 

13. (IF DRIVER'S LICENSE STATE GIVEN PREVIOUSLY AND NOT EQUAL TO 0, ASK 
13. a.; OTHERWI^^E, ASK 13. b.) 

a. 'ou told us in 1989 that your driver's license was issued in (FILL IN FROM 
PRELOADED DATA); Is that still correct? 

(1) YES. (GO TO 13. c. IF DRIVER^S LICENSE NUMBER AVAILABLE, OR 
13. d. IF NOT) 

(2) NO. (CORRECT EXISTING DATA; THEN GO TO 13. c. IF LICENSE 
NUMBER AVAILABLE OR 13. d. IF NOT) 

b. In what slate was your drivers license issued? [FC - FOREIGN COUNTRY OR 
INTERNATIONAL LICENSE. NA = DOES NOT HAVE DRIVERS LICENSE.) 

STATE: (IF "NA" OR "FC\ GOTO COMPLETION SCREEN; 

OTHERWISE, GO TO 13. c IF DRlVER^S LICENSE NUMBER AVAILAB^ E, IF 
NOT GO TO J. 13. d.) 

c. You told us in 1989 that your driver's license number was ; 

Is that still correct? 

(1) YES. (GO TO COMPLETION SCREENS) 

(2) NO. (CORRECT/COMPLETE AS NEEDED AND GO TO COMPLETION 
SCREEN) 

d. What is your drivers license number 



i 
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COMPLETIOIl SCREENS 



lUSCR CXrr to select a random number between 0 AND 1 AND 
DETERMINE II- RESPONDENT IS SELECTED FOR FOLLOWU? INTERVIEW. 
DETERMINATION SHOULD ALLOW FOR Dl'FEERBNTI^'- •'^FLECTION WITHIN THE 
THRP K WORKSHHET GROUPS , EVEN THOUGH INITIALLY SELEC^FION CRITERIA 
WILL BE THE SAME. INITIAL SELECTION RATES WITHIN EACH GROUP ARE; 

IF (RANDOM £^ .(WS) SELECT FOR RELIABILITY REINTERVIEW (OO TO A) 

ELSE, IF (.06 < RANDyy ^ .103) SELECT FOR VALIDITY REINTERVIEW UK) 
lO A). 

OTHERWISE, NOT SLLECI ED. (GO TO B). 



A. [READ TO RESPONDENT] 

Yen have been riuulninly seKctetl hy our coinpiiti-r for J(>IIo\vup interviuwinj.-. Wr would like 
(o call >iiu IiatI, in tuo to three weeks i-.nd verify some ol your respi)i;^.c>,. When would he a 
jjiood time to call? 

IINTLRVIEWER: FIRST ANSWER-DID THE RESPONDENT REFUSE. TO 
PARTICIPATE IN THE REINTERVIEW.' 

1 = YES. [GO TO B| 

2 - NO. 

DATE: 

TIME: 



(CONVERT TO EASTERN TIME FOR SUBSEQUENT APPOINTMENT SCHEDULING.] 

B. That completes our survey. Thank you for your assistance. Your participation will help make 
this surv ey a success. 

(TIME STAMP ON COMPLETION SCREEN) 
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Section Administration Times. 

Overall administration times, shown in Table C.L clearly indicate the need to shorten 
the instrument for the full-scale survey; specific areas for interview shortening arc best 
determined by examining timing data within the various sections of the interview. Tliose 
statistics and specific recommendations for shortening the inter\'iew are provided below; 
these changes arc estimated to shave from 12.35 to 20.9 minutes from the interview 
administration. Statistics are computed only for those individuals who completed a given 
section in one session. 

Section A of the instrument was intended to rtintroduce the sample member to the 
sludy, to screen out incligibles, to collect data required for FTB identification, and to 
validate some important base year student characteristics. Completion times for this section 
arc provided in Table C.2. On average, this section required about 5 minutes to 



Table C.l. Average elapsed minutes to complete overall field-test interview by level 



Level 


First Estimate' 


Second 
Estimate^ 




AVG 


SD 


Ql 


Q2 


Q3 


AVG 


Less Than 2-year 


127 


52.02 


20.03 


35.93 


49.82 


63.28 


55.20 


2-year 


120 


56.48 


21.63 


42.12 


53.31 


66.57 


58.28 


4-year 


176 


57.20 


15.83 


45.76 


54.58 


67.45 


58.38 


Total 


423 


55.44 


18.99 


44.86 


52.98 


65.89 


57.59 



^ These estimates are based on these who co^Tiplcted the interview in one session. 

^ W=Nijn±>er of cases cocipleting the full interview at once; AVG=Averagc; SD^Standard Deviation; Ql=1st 
quartile, Q2=2nd quartile, or median; Q3=3rd quartile. 

These estimates are the sLsns of th(. means of section completion times. See the individual section ti ""ng 
tables which follow for sample sizes. 
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Table C.2. Average elapsed minutes to complete Section A (Intrcxluction and Validation) 
of the ticld' test interview by level 



Level 


Section A - Introduction and Validation 


N' AVG SD Ql Q2 Q3 j 


Less Than 2-year 


167 5.47 2.40 3.77 5.10 6.57 


2-year 


171 5.27 2.26 3.78 4.77 6.32 


4-year 


260 4.38 2.36 3.19 4.04 5.08 


1 Total 


598 4.94 2.39 3.48 4.45 5.83 



Holt: Ther>e statistics oit based or» the ?i98 Cfisc^. for whom Section A war, ccxt^jlttf-d in om session. 
AVG=Average; SO=Standard Dcviotion; Ql=1st quart Uo, Q2=2nd quart ile, or median; Q3=3rd quartile. 



administer. It took somewhat les.s time for sample members selected from four-year 
institutions than for those from less than four-year institutions. For this length of time, 
variation Is relatively large. 

An examination of the timing of interview segments within Section A are provided in 
Table C.3. The clear major time consumer in Section A is ttic introductory segment. This 
segment provided assurances of confidentiality, implied consent information, other 0MB 
required statements, and questions to determine if the lead letter and appropriate worksheets 
had been received. In debriefing sessions, the interviewers suggested that the long 
introduction frequently caused hesitation to continue on the part of sample members. Three 
areas c»re immediately suggested for cutting this segment: (1) reduction of the introductory 
remarks for all individuals, (2) further reduction of the intnxluctory remarks for those who 
received the letter (plans for later mailing of the lead letter to subjects should also increase 
the number who actually receive the letter and thus need only the abbreviated introduction), 
and (3) elimination of the letter remail screen wording. We estimate savings of from 1 to 
1.5 minutes from these changes. 

Sect ion B was, as expected, the most time consuming section of the interview, 
averaging over 17.5 minutes. Considerable variation in completion times existed, with 
standard deviations and interquartile ranges for the several groups defined in the table 
varying from about 8 to 12 ninules. 

This section determined all institutions in which the sample member was enrolled, 
each term he/she attended each school, transfer information, basic information about each 
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term, participation in and satisfaction with various school activities/services, grades, special 
s^r\'iccs received, and how those services were administered. Since number of institutions 
attended as well as number of terms attended each generated additional response alternatives 
for respondents, one would expect differences among institution levels. This is supported in 
Table C.4 by the markedly lower completion times for those in less-than-two-year institutions 
(where simpler and shorter schooling patterns exist). Systematic differences as a function of 
institutional control within level were not observed. 

Times to complete the various interview segments within Section B are shown in 
Table C.5. We had expected that the repeats of Item B.7 (asked for each enrollment term 
identified) would be the most time consuming segment within this section; however, the 
participation in, and satisfaction with, school activities (items B.8 ;nd B.9) took almost 1.5 
times as long to administer than item B.7. Besides these two segments, the remaining large 
time consumer was the first segment, involving principally the introduction and 
verification/entry of ail terms at the NPSAS school. It should be noted that the averages for 
the second through fourth segments listed in Table C.5 include times of zero, since some 
sections were not applicable to individuals who had not attendcxl other schools or who had 
not been enrolled since February 1989. Also, the last segment of Table C.5 includes times 
of zero, where none of liie services specified in the previous segment were received. 



table C.3. Average elapsed minutes for specific sets of interview items in Section A 



Items In Set 


Purpose of Items 


AVG 


SD 


01 


Q2 


Q3 


A2A - A5 


Introduction and verify 


2.32 


1.23 


1.62 


2.15 


2.83 


A6- AlO' 


Verify correct subject 


0.38 


0.37 


0.23 


0.28 


0.37 


All - A18 


FTB Determination 


1.41 


1.08 


0.72 


0.97 


1.70 


A19 - A24 


Verify Nl^SAS, 
Demographic 


0.79 


0.7^ 


0.58 


0.70 


0.85 



NOTE: Those statistics arc brised on tlie 598 cases for whom Section A was conplctcd in one session. 
AVG=Average; SO=Stanclard Deviation; Ql=1st quiirtile, Q2=2ncl quartile, or median; Q3=3rd quartile. 

1 Those not verified as correct subject are not included cince they did not conipletc Section A; 
consequently these statistics reflect time to administer Question A6 only. 
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Table C.4. Average elapsed minutes to complete Section B (Education Experience) for the 
ficld-lcsl interview by level 







Section B 


- Education Experiences 




Level 


N 


AVG 


SD 


Ql 


Q2 


Ql 


Less Than 2-year 


252 


15.45 


8.80 


9.61 


13.63 


18.68 


2-year 


282 


18.13 


9.61 


10.33 


17.05 


23.05 


4-year 


470 


18.40 


8.24 


12.85 


16.87 


22.45 


Total 


1004 


17.58 


8.86 


11.20 


16.13 


21.93 



Mote: These r.tat i Ktici, nre based on the 1,004 cauea for whwn Section B i^as cofnpleted in one session. 
AVG=Averago; SD^Standard Deviation: Ql=1st quart! le, Q2=2nd quartile, or median; Q3=3rd quartile. 



Table C.5. Average elapsed minutes for specific sets of interview items in Section B 



Items In Set 


Purpose of Items 


AVG 


SD 


Ql 


Q2 


Q3 


B-B2 


Introduction, Enrollment 
NPSAS School 


3.06 


2.88 


1.54 


2.47 


3.85 


B3-B5 


Enrollment Other School- 
IPEDS Coding 


0.23 


0.50 


0.00 


0.00 


0.27 


B6' 


Transfer Information 


0.47 


1.00 


0.00 


0.00 


0.62 


B7' 


Term Information 


4.22 


3.13 


2.08 


3.62 


5.68 


B8-B9 


Schoo! Activities and | 6.10 
Satisfaction • 


2.83 


4.15 


5.20 


7.43 


BlO-Bli 


Grades at Schools 


0.76 


0.66 


0.42 


0.58 


0.83 


B12-B14 


Receiving Services 


1.73 


J .07 


1.03 


1.62 


2.25 


B35-B16 


How Received Services 


1.02 


0.82 


0.48 


0.93 


1.43 



NOTE: Thv-sc -^f't irUi cs are based on the 1,004 cases for whon- Section B was cofrplctcd in one session, except 

as noted otherwise. AVG-Average; SD-Standard Deviation; Ql=1st quartile, Q2=2nd quartile, or median; Q3=3rd 
quart i le. 

' N for this itefn net is 1,003 due to bad time stamps. 
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Section B also contained a number of "repeat" segments, wherein the same 
questions were asked repeatedly to respondents for each term, school, etc. Table C.6 
provides relevant statistics for the repeat segments. Not all sample members needed to 
respond to all repeats, as shown in the table; these cases were not included in the average 
times shown. Average time to complete one repeat of segment B7 was about 1.6 minutes for 
the 925 sample members with non-zero timing data for one or more repeats; however, 
average minutes for the first repeat (not shown in table) was somewhat higher, 2. 1 minutes, 
as expected, due to gained respondent familiarity with the questions and the fact that 
subsequent terms in the same school were programmed to use as prompts, where possible, 
information collected from previous terms. Average time for the second repeat had dropped 
to 1.2 minutes, and for final repeats had dropped to about .9 minutes. The questions about 
participation-in/satisfaction-with school activities averaged about 4.6 minutes each (4.7 for 
first repeat, 3.5 for second, and about 3.1 for final repeats). For the 786 cases reporting 
receipt of services, the service-receipt repeats averaged about 38 seconds. 



Table C.6. Statistics for repeat segments within Section B of interview 





Number of Repeals* 


Average Time^ to Complete 1 Segment^ 




Repeal Segment 


MIN 


MAX 


AVG 


Number 
of Cases 


AVG 


SD 


Ql 


Q2 


Q3 


B7: Term 

Informalion 


0 


9 


3.20 


925 


1.61 


1.03 


0.94 


1.32 


1.95 


B8-9: School 

Activities and 
Satisfaction* 


1 


5 


L39 


1003 


4.55 


1.52 


3.70 


4.30 


5.10 


B15-16: Types of 
Services 


0 


7 


1.71 


786 


0.63 


0.41 


0.44 


0.54 


0.73 



' These statistics are based on the 1,00A cases for which Section B was cocpleted in one session, 
noted otherwise. AVG=Average; SD^^Standard Deviation; Q1=1st quartile, Q2=2nd quartile, or medians- 
quart i le. 



^ Time in minutes. 

^ Excludes cases with zero repeats. 

* N for this item is 1,003 due to bad time stamps. 
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Considering both Table C.5 and C.6, it seems clear that time savings are available in 
a number of areas. Major savings are available only in questions B7, B8, B9, and B12 - 
B16. The latter set of questions are asked principally to obtain comparison data for another 
ED study, but the time required for administration of these items is almost three minutes. It 
would seem that the essence of information needed for this peripheral activity could be 
reduced and collected in less time. One option would be to collect the information for only 
one academic year (perhaps the "first" year, estimated savings of about one minute; 
maximum savings by eliminating the question would be 2.75 minutes). Some time savings 
could also be achieved in the B7 item set, if information needed can be rec.uced. Savings 
could also be realized by introducing more automation for "same as previous term" across 
repeats (and perhaps across schools). 

Big savings could also come from questions B8 and B9. Some items that were 
suggested as candidates for deletion are those of a social nature (B8.c, B8.d, B8.e, and 
B9.C,), those with relatively low frequency of participation (B8.f, B8.g, B8.i, B8.j, and B8.k 
answered "never" by from 69 to 90 percent of respondents), or those that are somewhat 
peripheral or have relatively high nonapplicability or misinterpretability (B9.i, B9.1, B9.m, 
B9.n, B9.0, and B9.q). Additionally, B9.a, B9.b, and B9.p are somewhat redundant. 
Elimination of 15 of these items would cut approximately 2.5 minutes per repeat of these 
items and about 3.5 minutes from the average administration time. Additional time can also 
be saved by asking these questions for primary or principal schools or by asking certain 
questions only to those at certain types of institutions. Alternately, B.8 and B.9 could be 
asked only for "principal" schools as suggested by interviewers. 

One final possibility for time savings in Section B would be reduction, or complete 
elimination, of the transfer items. From Table C.5, it is clear that less than half of the 
sample members had attended more than one school (i.e., median times for B3-B5 is 0) 
which is reflected in the fact that the transfer questions are inapplicable. Actually, only 180 
(16 percent) of the individuals completing Section B reported that they had transferred (or 
even planned to transfer) credits from one school to another. While time savings for 
eliminating this question would be small (.5 minutes), this half minute expenditure for a 
relatively small return seems questionable. 

Following one or more of the several recommendations for rexiuctions in Section B, 
we estimate a total of 5 to 6.75 minutes could be saved. 

Section C of the interview collected information about educational costs and 
financing for each term since February 1989. As such, the section was not applicable (and 
therefore not administered) to all respondents; consequently, some timing results for this 
section include cases with zero and near zero administration times, which depresses the 
overall administration time for the section. On the other hand, as reported by interviewers, 
those who completed the various parts of this section generally required a great deal of 
prompting in order to provide even "estimates" of some aspects of educational expenses and 
financial aid packages received, which inflates administration time. 
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Overall timing results for this section are provided in Table C.7. The reported 
overall time of 6.5 minutes is increased to almost 7 minutes when those not attending since 
February 1989 are excluded. Required administration time (average and median) increases 
slightly with level of offering, probably reflecting greater numbers of terms, more types of 
expense elements, and more complex aid packages for students in the higher level 
institutions. Within institutions offering programs of two-years or more, students from 
independent non-profit institutions require longer administration times than did public or 
proprietary students; however, within the less-than-two-year category, administration times 
were somewhat more homogeneous. 

Timing of subsections of the educational financing section are provided in Table C,8, 
and repeat segment statistics within this section are given in Table C.9. Time savings within 
this section are difficult to obtain, since the information is critical to the purpose of the study 
and since the subsection timings are relatively low to begin with. Note, however, that the 
3.16 minutes for administration of questions C1-C5 is principally a function of number of 
terms (average administration time per repeat is only about 1.25 minutes). This suggests a 
potential time savings if these data were to be collected by school year within school rather 
than by term within school. Since total amount of financial aid is already collected only at 
the school-year level, this would also seem a reasonable approach 



Table C.7. Average elapsed minutes to complete Section C (Educational Finances) for the 
field-test by level 



Section C - Education Financing 



Level 


N 


AVG 


SD 


Ql 


Q2 


Q3 


Less Than 2-year 


251 


5.59 


4.24 


3.33 


4.55 


6.83 


2-year 


279 


6.35 


5.50 


3.13 


5.32 


8.78 


4-year 


466 


7.02 


4.45 


4.35 


6.19 


8.72 


Total 


996 


6.47 


4.75 


3.68 


5.52 


8.18 



NOTE: These statistics are based on the 996 cases for whom Section C was connpleted in one session. 
AVG=Average; SD=Standard Deviation; Q1=1st quartile, Q2=2nd quartile, or median; Q3=3rd quartile. 
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Table C.8. Average elapsed minutes for specific sets of interview items in Section C 



Items In Set 


Purpose of Items 


AVG 


SD 


Ql 


Q2 


Q3 


C Intro 


Introduction to C 


0.95 


1.64 


0.53 


0.75 


0.92 


CI - C5 


Expenses and Aid by Term 


3.16 


2.73 


1.38 


2.67 


4.23 


C6 - C7' 


Expenses met by Financial 
Aid 


0.73 


1.37 


0.00 


0.02 


1.05 


C8 - C12' 


Other Financial Information 


1.60 


1.21 


0.98 


1.38 


1.98 



NOTE: Except where noted otherwise, these statistics are based on the 996 cases for whom Section C was 
completed in one session. AyG=Avei age; SD=Standard Deviation; Ql=lst quart i I e, Q2=2nd quart ile, or median; 
Q3=3rd quarti le. 

' These results are restricted to those with good time stamp data (N=979). 



Table C.9. Statistics for repeat segments within Section C of interview 



Repeat Segment 


Number of Repeats 


Average Time to Complete 1 Segment' 


MIN 


MAX 


AVG 


Number 
of Cases 


AVG 


SD 


Ql 


Q2 


Q3 


Cl-5: Expenses and Financial 
Aid by Term 


0 


9 


2.99 


924 


1.25 


0.97 


0.73 


0.99 


1.37 


C6-7: Amount and Percentage of 
Financial Aid ma. by 
Year 


0 


1 


0.55 


398 


1.30 


1.15 


0.67 


0.94 


1.52 



NOTE: AVG=Average; SO=Standard Deviation; Ql=1st quarti le, Q2=2nd quarti le, or median; Q3=3rd quarti le. 



Excludes cases with zero repeats. 



for expenses (particularly since many respondents had considerable difficulty in reporting 
expenses by term). The estimated savings in average time is at 1.25 to 1.75 minutes. 
Another possibility, maintaining the same collection points, would be to add "same as 
previous term" options (within school) for this set of repeat questions. Savings here would 
not be as dramatic, but are estimated at about .5 minutes. Obviously the collection of less 
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inforir-^ ' ^n, particularly per-term expenditures (that were very time consuming"* \vould 
shorter each segment. Some estimates of expenses could be obtained from IPHDS data. 



As with Section B, interviewers reported difficulty with the introductory portions of the 
section; however, that section provides the definitions needed to maintain some semblance of 
comparability of responses provided. Similarly the information provided in questions C6 and 
C7 regarding amount of financial aid (with checks) are already asked only by academic year, 
and probably should be asked by year within school, which would increase administration 
time. Remaining questions in the section are already restricted to a very small subset of 
items, and require only 1.6 minutes to administer. | 



A remaining possibility /or reducing the average acj|ninistration time of this section (and 
of Section B) would be to restrict the time frame for collecting the data to only those terms 
that were ongoing at, or started since, 1 June of 1990. This would assume that the NPSAS 
data collection covered all spring terms in 1990, but potentially not the first summer term (if 
any). Resultant time savings for this approach would be approximately 1.5 minutes. Overall 
time savings for this section are from 1 to 2 minutes (note that not all optional approaches 
are mutually exclusive and that some increases are required in C6 and C7). 

Section D of the interview collected information about each of the jobs held (and 
unemployment periods) since February 1989, including detailed information needed for 
industry and occupational coding, salary, hours worked, etc. Average time to complete the 
section, by type of NPSAS:90 in|tttution, is given in Table C. 10. Since 77 respondents had 
not held a job (for pay) during the period, average time for completion of the section 
includes these cases with completion times of less than a minute. 

The average overall administration time was 9.2 minutes (median 8.3). Timing varied 
over level of offering, with respondents from two-three-year institutions averaging about a 
minute less than the overall avera^^e and those from four-year institutions averaging about 
two-thirds of a minute more. 

Elapsed time data for subsections and repeat segments of Section D are provided in 
Tables C. 11 and C.12, respectively. The obvious target for time reduction in this section is 
the set of questions about specific jobs, which accounts for the bulk of the questions (and 
time for completion) of the section, and which take, on average, about 3.3 minutes to 
administer. While detail on jobs is important in some cases, it is not considered particularly 
relevant to short-term jobs, part-time jobs, or jobs held while attending (or between sessions 
of attending) school. 

Consequently, our major recommendations for shortening this section involve the 
reduction of questions asked about certain types of jobs. Specifically, we would recommend 
moving the summary screen to the beginning of the section. Following this question we 
would ask whether the respondents considered themselves principally employees or students. 
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Table C. 10. Average elapsed minutes to complete Section D (Work Experience) of the 
field-test by level 



Level 


Section D - Work Experiences 


N 


AVG 


SD 


Ql 


Q2 


Q3 


Less Than 2-year 


243 


8.97 


6.03 


5.13 


7.95 


11.77 


2-year 


277 


8.33 


5.25 


4.73 


7.40 


11.22 


4-year 


458 


9.85 


5.78 


6.02 


8.86 


13.08 


Total 


978 


9.20 


5.73 


5.40 


8.26 


12.35 



NOTE: These statistics are based on the 978 cases for whom Section D was cornpleted in one session. 
AVG=Average; SD=Standard Deviation; Ql=1st quart ile, Q2=2nd quartile, or median; Q3=3rd quart ile. 



Table C.l L Average elapsed minutes for specific sets of interview items in Section D 



Items In Set 


Purpose of Items 


AVG 


SD 


Ql 


Q2 


Q3 


D -D2 


Job History 


1.17 


1.67 


0.67 


0.83 


1.05 


D3 - D19 


Employment and Job 
Information 


6.98 


4.89 


3.65 


5.90 


9.75 


D20 - D21 


Satisfaction and Perceived 
Status 


0.62 


0.45 


0.38 


0.60 


0.80 


D22 


Non-Employment Periods 


0.42 


0.6C 


^ 00 


0.22 


0.63 



NOTE: These statistics are based on the 978 cases for Hhom Section D was completed in one session. 
AVG=Average; SD=Stor>dard Deviation; Ql=1st quartile, Q2=2nd quartile, or median; Q3=3rd quartile. 
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Table C.12. Statistics for repeat segments within Section D of interview 



I 



Repeat Segment 


Number of Repeats 


Average Time to Complete 1 Segment^ 


MIN 


MAX 


AVG 


Number 
of Cases 


AVG 


SD 


Ql 


Q2 


Q3 


D3-D19: Employment and Job 
Infonnation by Job 


0 


6 


2.32 


901 


3.28 


1.52 


2.28 


2.95 


3.90 


D22; Non-Employment 
Periods 


0 


5 


0.86 


547 


0.50 


0.37 


0.23 


0.38 


0.67 



NOTE: AVG=Average; SD=Standard Deviation; Ql=1st quartile, Q2=2nd quarti le, or median; Q3=3rd quartile. 



Excludes cases with zero repeats. 



Detailed questions about employment would be asked only about jobs held since last 
attending school, except for individuals who considered themselves principally employees 
who were attending school as a secondary activity. Further, detailed questions could be 
restricted to "principal" jobs in each of the two calendar years (1990 and 1991). It would 
still be important to collect information about whether a job held while still attending school 
was a co-op job, related to area of study, on~campus or off-campus, and possibly educational 
requirements for the job, full/part time questions, and hours per week worked (D5-7, Dll, 
D14, and D15). Industry classification literal responses, seasonality of job, occupational 
classification literal responses, salary, and educational/training benefits from such jobs 
(D3.b-e, D8-9, D13, D16~19) would not be asked of "students". 

Other potential items to be dropped include: salary information (which can be 
picked up as the portion of annual income that is earned , in another section); hours worked 
per week (relying on the full-Zpart-time question); and seasonality of job. Also, questions 
relating to spells of unemployment (D22) would not be asked of current students. Other 
questions in the repeat segment (D3-D19), where asked, would be under the same skip logic 
currently in use (based on full/part time and length of employment — see Appendix C); 
however, we would also recommend completely removing questions related to work status at 
the start of the job (DIO and D12). These several revisions to the section are estimated to 
save (in total) from 3.8 to 4.8 minutes in average administration time. 

Section E timing data are provided in Table C. 13. This section included questions 
regarding training/education other than that covered in Sections B and D. Average time to 
complete the section was about 1.6 minutes, which, in the main, represented timing for the 
introduction and screening question to determine if respondents had participated in any such 
education. Only 150 respondents (16 percent of those completing the section) reported 
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Table C.13. Average elapsed minutes to complete Section E (Other Education/Training) for 
the field-test by level 



Level 


Section E ■■ Other Education or Training 


N 


AVG 


SD 


Ql 


Q2 


Q3 


Less Than 2-year 


237 


1.76 


1.91 


0.83 


1.25 


1.83 


2-year 


270 


1.71 


1.58 


0.80 


1.28 


1.85 


4-year 


442 


1.52 


1.47 


0.78 


1.17 


1.58 


Total 


949 


1.63 


1.62 


0.80 


1.23 


1.68 



NOTE: These statistics are based on the 949 cases for whom Section E was completed in one session. 
AVG=Average; SO=Standard Deviation; Ql=1st quartile, Q2=2nd qur-rrile, or median; Q3=3rd quartile. 



participation in such education/training activities. For those who did participate in such 
activities, the section provided some additional burden. No systematic meaningful trends 
exist in completion time as a function of level or control of the NPSAS:90 school. 

No internal time stamps were imbedded in this or subsequent sections of the 
interview, and there is little room for reduction of interview administration time for this 
section. Nonetheless, an estimated gain of about .2 minutes could be achieved by asldng the 
more detailed questions about these other education/training experiences only of those who 
earned CEUs for the training or took the training as a work-related activity (approximately 
60 percent of those reporting such activities). This would also reduce the burden on those 
with a number of such activities that were basically for personal enrichment. An estimated 
.5 minutes could be saved by collapsing questions E3-E7 to encompass summary information 
over all training within designated categories (rather than for each course or program, as is 
currently the case), eliminating dates of completion and length of courses/programs (E3.b, 
E3.C, E4), and couching remaining questions in terms of "any" (or "all") of the 
courses/programs (e.g., E5 would be "Have you earned, or do you expect to earn CEUs for 
any of these programs?"). A further reduction would involve simply asking whether the 
respondent participated in any such activities, and if so, how many and whether any of these 
were job related; we estimate a total savings here of about .7 minutes. A total of 1.6 
minutes could be eliminated by dropping the section entirely, considering only 177 
respondents (17 percent of those answering the section) reported any such training. 

Section F collected information about respondents living arrangements, marital 
status, children, and disability status. Timing data, provided in Table C.14, indicate an 
overall average time of about 1.7 minutes. Those in four-year institutions show a slightly 
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lower time for completing the section, but there are no trends over institutional control. This 
section provides little room for reduction in administration time; however, some savings can 
be realized by programming more checks for administering these highly related questions 
(e.g., no need to ask about having children if person had already indicated in F Lb. 8, that 
they were living with children). Also, determination of counts of individuals with whom 
respondent lived (Fl.b.5_N through Fl.b.lO^N) could be eliminated. Overall item savings 
from these changes are estimated at no more than .3 minutes. 

Section G timing information, by NPSAS:90 school type, is provided in Table C.15. 
This section collected information about personal income, household income, caretaker 
responsibilities, and, '; ;-::re applicable, detailed data regarding spouse's/partner's job, 
income, and education. Average time to complete this section was about 3.5 minutes. 
Longer times to complete the section was a direct function of being married, since the 
information items collected about spouse/partner comprised about half of the burden for those 
cases in which the questions were applicable. Married students were concentrated in the 
less-than-four-year institutions, and within four-year institutions were more prevalent in the 
public sector institutions, which easily explains the overall timing differences by level. 

As expected this section, involving income questions, produced the highest number 
of indeterminate responses (i.e., refusals or "don't know" - DK). In considering possible 
areas for time savings, item propensity for indeterminate responses should also be 
considered. From 37 to 39 percent of the respondents (for whom the question was 



Table C. 14. Average elapsed minutes to complete Section F (Demographics) for the field- 
test by level 



Level 


Section F - Demographic Information 


N 


AVG 


SD 


Qi 


Q2 


Q3 


Less Than 2-year 


240 


2.12 


1.15 


1.33 


1.90 


2.75 


2-year 


270 


1.92 


1.74 


1.02 


1.54 


2.33 


4-year 


449 


1.27 


0.81 


0.78 


1.07 


1.55 


Total 


959 


1.66 


1.27 


0.92 


1.35 


2.0« 



NOTE: These statistics are based on the 959 cases for whom Section F was completed in one session. 
AVG=Average; SD=Standard Deviation; Ql=1st quartile, Q2=2nd quartile, or median; Q3=3rd quartile. 
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Table C.15. Average elapsed minutes to complete Section G (Family Information) for the 
field test by level 



Level 


Section G - Family Information 


N 


AVG 


SD 


Ql ! Q2 


Q3 


Less Than 2-year 


238 


4.06 


2.25 


2.38 


3.52 


5.32 


2- year 


267 


3.94 


2.18 


2.45 


3.32 


5.10 


4-year 


443 


2.98 


1.46 


2.05 


2.65 


3.53 


Total 


948 


3.52 


1.96 


2.23 


2.98 


4.27 



NOTE: These statistics are based on the 948 cases for whom Section G was completed in one session. 
AVG=Average; SD=Standard Deviation; Ql=lst quartile, Q2=2nd quarti Le, or median; Q3=3rd quartile. 



applicable) either could not or would not answer the questions concerning household income 
during 1989, 1990, and 1991 (well over 85 percent of the indeterminacies were DK rather 
than refusals). By comparison, spouse/partner income for the three years (where applicable) 
elicited indeterminacy rates of from 16 to 22 percent, and personal income elicited rates of 
from 8 to 14 percent. Because the determination of household income is quite important, 
these items do not represent potential candidates for exclusion; however, it is recommended 
that spouse/partner salary be dropped, since spouse/partner total income is obtained. Also 
the projected income for the current year should probably be dropped for respondent and for 
spouse and household (where applicable). Estimated overall time savings here would not 
exceed .3 minutes. 

Other candidates for removal are those requesting detailed information items about 
spouse's job (items G1-G5). In particular, the information allowing occupatic nal coding (Gl 
- requiring alphabetic entries) and salary (G4) seem to be overkill. Removing these latter 
two spouse items is estimated to save about .4 minutes in overall adminismtion time while 
other removals within the spouse job subsection would provide an estimated additional 
savings of .2 minutes. Overall savings for the section are therefore no more than .9 minutes. 

Section H requested information about educational and occupational goals and plans; 
timing data for this ^.cction are provided in Table C.16. Overall time for completion of the 
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Table C.16. Average elapsed minutes to complete Section H (Goals/Expectations) of the 
field-test by level 



Level 


Section H - Goals, Aspirations, Expectations 


N 


AVG 


SD 


Qi 


Q2 


Q3 


Less Than 2-year 


232 


5.60 


2.39 


4.08 


5.08 


6.40 


2-year 


266 


6.05 


2.51 


4.20 


5.51 


6.98 


4-year 


444 


6.89 


2.73 


4.76 


6.42 


8.59 


Total 


942 


6.33 


2.64 


4.42 


5.67 


7.53 



NOTE: These statistics are based on the 9A2 cases for whom Section ri was completed in one session. 
AVG=Average; SD=Standard Deviation; Ql = 1st quart 1 1 e, Q2=2nd quart ile, o" median; Q3=3rd quartile. 



section was about 6.3 minutes. Time to complete the section generally increases over level 
of offering. This increase is probably closely related to more students planning graduate 
school in the higher level of offering institutions. 

Some time will be saved in this section by incorporating screening questions for 
graduate school plans (as discussed in Section V.D and VI. G) by eliminating confusion and 
faltering on the part of the respondent when plans for graduate school are not specific. Other 
savings in the section can be obtained from the sets of questions looking at specific education 
and occupational status goals in a reduced number of future windows. Currently, 4 windows 
are used, corresponding to 1,2, 5, and 10 years hence. As should be expected, DK 
responses on educational plans showed a slight increase over more and more distant future 
time points. Since the three currently planned follow-ups in the BPS:90 study series do not 
include the 10 year window, it is suggested that questions about this window be dropped 
(H13 and H17). It would seem that other windows could also be dropped without adversely 
affecting information obtained. Indeterminate response analysis suggested (see Section V.D) 
that individuals who plan to be in school at future time points have (not unexpected) 
difficulty in providing specifics about job plans at those time points. Consequently (and in 
line with our recommendations for Section D), we recommend that specific employment 
information not be requested at time points when the individual has previously indicated that 
schooling is planned. A final recommended time saver in this section is the inclusion of a 
question about whether future jobs will be the same as current job (for those currently 
employed), which, if true, will preclude having to recollect information already collected in 
Section D. We estimate the overall time savings from these modifications to be from 1.25 to 
1.75 minutes. 
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Section I timing statistics are provided in Table C.17; this section requested 
information about behavior in the areas of voting, public service, and military service. 
Average completion time was about 1.7 minutes. No systematic or meaningful differences 
existed as a function of institutional level or control. No potential candidates for reductions 
are apparent in this section. Some time savings (about .1 minutes) could be obtained by 
rewording questions about extent of public servi'^e work (17 and 18. c). Interviewer 
debriefmgs indicated that most respondents had difficulties in determining hours per week but 
could, when prompted, provide total hours (which interviewers then converted by using 
calculators). These items should be reworded to request total hours during the time periods. 

Section J obtained information needed to help locate respondents in subsequent 
follow-ups of the BPS:90 series of surveys. As shown in Table C.18, average time to 
complete this section was 4.6 minutes. Average tipping and other distributional features were 
quite stable over the various levels of institutional offering and control. Generally the time 
distributions were much more regular than in most other sections. 

One of the reasons for the length of this section is the number of literal string 
responses required of the respondent (and the associated time for interviewers to key this 
information into the CATI record). As inaicated in Section VLG (see below), some time 
savings can be achieved through increasing the number of fixed response alternatives for 
some of the questions; however, the more difficult alphabetic responses, names and 



Table C.17. Average elapsed minutes to complete Section I (Public Service and Voting) for 
the field-test by level 



Level 


Section I - Public Service and Voting ExperienCv-; 


N 


AVG 


SD 


Qi 


Q2 ! Q3 


Less 1 nan 2-year 


236 


1.59 


1.12 


0.83 


1.14 


2.13 


2-year 


266 


1.73 


1.18 


0.88 


1.24 


2.35 


4-year 


444 


1.65 


1.00 


0.85 


1.25 


2.35 


Total 


946 


L66 


1.08 


0.85 


1.22 


2.30 



NOTE: These Statistics are based on the 9A6 cases for whom Section I was completed in one session. 
AVG=Average; SD=Standard Deviation; Ql=1st quartile, Q2=2nd quartile, or median; Q3=3rd quartile. 
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Table C.18. Average elapsed minutes to complete Section J (Lx)cator Information) for the 
field-test by level 



Level 


Section J - Locator Information 


N 


AVG 


SD 


Qi 


Q2 


Q3 


Less Than 2-year 


236 


4.58 


1.76 


3.33 


4.35 


5.51 


2-year 


266 


4.86 


2.17 


3.33 


4.51 


5.88 


4-year 


443 


4.43 


1.58 


3.35 


4.18 


5.35 


Total 


945 


4.59 


1.82 


3.33 


4.30 


5.52 



NOTE: These statistics are based on the 945 cases for whorn Section J was completed in one session. 
AVG=Average; SD=Standard Deviation; Ql=1st quart ile, Q2=2nd quart ile, or median; Q3=3rd quart i I e. 



addresses, will still remain (even though the preloads, fill-ins, and checks already built into 
the program already represent a major reduction in the number of such responses that are 
required). Preliminary examinations of the full-scale study address files suggest that 
preloaded data will be somewhat more complete than the field test data, which will, in itself, 
provide some time savings. Beyond these recommendations, two items in Section J are 
recommended for deletion: JIO, which updates "nickname" information, and Jll, name of 
spouse. These items of information are theoretically useful for long-term tracing even 
though neither was used in the current field test. Nonetheless, both are considered "long- 
shots" and not worth the time needed for administration to all students. One other 
modification recommended is to eliminate spouse as a locator source in Jl, J2, and J3 (this 
would mean no updating of previously provided spouse locator source [Jl and J2] and 
excluding spouse as an option in J5). These changes would achieve an estimated time 
savings of from .6 to 1.2 minutes. 
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